You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@sd-datasolutions.de> on 2012/12/18 01:02:49 UTC

[JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_09) - Build # 2203 - Failure!

Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Windows/2203/
Java: 32bit/jdk1.7.0_09 -server -XX:+UseConcMarkSweepGC

4 tests failed.
REGRESSION:  org.apache.solr.cloud.ShardRoutingTest.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 180 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 180 seconds
	at __randomizedtesting.SeedInfo.seed([C86105B07D04D6DF:49878BA80A5BB6E3]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:175)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:125)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:120)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:557)
	at org.apache.solr.cloud.ShardRoutingTest.doTest(ShardRoutingTest.java:116)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:794)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ShardRoutingTest

Error Message:
ERROR: SolrIndexSearcher opens=15 closes=14

Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=15 closes=14
	at __randomizedtesting.SeedInfo.seed([C86105B07D04D6DF]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:243)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:97)
	at sun.reflect.GeneratedMethodAccessor19.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ShardRoutingTest

Error Message:
4 threads leaked from SUITE scope at org.apache.solr.cloud.ShardRoutingTest:     1) Thread[id=1360, name=qtp29204452-1360, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:867)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1197)         at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:214)         at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:290)         at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:490)         at org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:95)         at org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:64)         at org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit(DistributedUpdateProcessor.java:1041)         at org.apache.solr.update.processor.LogUpdateProcessor.processCommit(LogUpdateProcessorFactory.java:157)         at org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandlerUtils.java:69)         at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)         at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:146)         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1819)         at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:458)         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:279)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)         at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:116)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)         at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)         at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)         at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)         at org.eclipse.jetty.server.Server.handle(Server.java:365)         at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)         at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)         at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)         at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:722)    2) Thread[id=1357, name=qtp29204452-1357, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:867)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1197)         at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:214)         at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:290)         at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:490)         at org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:95)         at org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:64)         at org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit(DistributedUpdateProcessor.java:1041)         at org.apache.solr.update.processor.LogUpdateProcessor.processCommit(LogUpdateProcessorFactory.java:157)         at org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandlerUtils.java:69)         at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)         at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:146)         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1819)         at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:458)         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:279)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)         at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:116)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)         at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)         at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)         at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)         at org.eclipse.jetty.server.Server.handle(Server.java:365)         at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)         at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)         at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)         at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:722)    3) Thread[id=1358, name=qtp29204452-1358, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at java.lang.Thread.sleep(Thread.java:338)         at org.apache.lucene.store.RateLimiter$SimpleRateLimiter.pause(RateLimiter.java:111)         at org.apache.lucene.store.RateLimitedIndexOutput.flushBuffer(RateLimitedIndexOutput.java:45)         at org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:90)         at org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:79)         at org.apache.lucene.store.RateLimitedIndexOutput.flush(RateLimitedIndexOutput.java:69)         at org.apache.lucene.store.BufferedIndexOutput.close(BufferedIndexOutput.java:103)         at org.apache.lucene.store.RateLimitedIndexOutput.close(RateLimitedIndexOutput.java:78)         at org.apache.lucene.store.ChecksumIndexOutput.close(ChecksumIndexOutput.java:61)         at org.apache.lucene.util.IOUtils.closeWhileHandlingException(IOUtils.java:203)         at org.apache.lucene.index.SegmentInfos.rollbackCommit(SegmentInfos.java:853)         at org.apache.lucene.index.SegmentInfos.finishCommit(SegmentInfos.java:932)         at org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:2826)         at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2815)         at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2788)         at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:529)         at org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:95)         at org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:64)         at org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit(DistributedUpdateProcessor.java:1041)         at org.apache.solr.update.processor.LogUpdateProcessor.processCommit(LogUpdateProcessorFactory.java:157)         at org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandlerUtils.java:69)         at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)         at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:146)         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1819)         at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:458)         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:279)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)         at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:116)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)         at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)         at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)         at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)         at org.eclipse.jetty.server.Server.handle(Server.java:365)         at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)         at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)         at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)         at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:722)    4) Thread[id=1368, name=searcherExecutor-757-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)         at java.lang.Thread.run(Thread.java:722)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE scope at org.apache.solr.cloud.ShardRoutingTest: 
   1) Thread[id=1360, name=qtp29204452-1360, state=WAITING, group=TGRP-ShardRoutingTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:867)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1197)
        at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:214)
        at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:290)
        at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:490)
        at org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:95)
        at org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:64)
        at org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit(DistributedUpdateProcessor.java:1041)
        at org.apache.solr.update.processor.LogUpdateProcessor.processCommit(LogUpdateProcessorFactory.java:157)
        at org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandlerUtils.java:69)
        at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:146)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1819)
        at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:458)
        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:279)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:116)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
        at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
        at org.eclipse.jetty.server.Server.handle(Server.java:365)
        at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
        at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
        at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)
        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
        at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
        at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
        at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
        at java.lang.Thread.run(Thread.java:722)
   2) Thread[id=1357, name=qtp29204452-1357, state=WAITING, group=TGRP-ShardRoutingTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:867)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1197)
        at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:214)
        at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:290)
        at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:490)
        at org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:95)
        at org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:64)
        at org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit(DistributedUpdateProcessor.java:1041)
        at org.apache.solr.update.processor.LogUpdateProcessor.processCommit(LogUpdateProcessorFactory.java:157)
        at org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandlerUtils.java:69)
        at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:146)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1819)
        at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:458)
        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:279)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:116)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
        at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
        at org.eclipse.jetty.server.Server.handle(Server.java:365)
        at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
        at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
        at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)
        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
        at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
        at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
        at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
        at java.lang.Thread.run(Thread.java:722)
   3) Thread[id=1358, name=qtp29204452-1358, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]
        at java.lang.Thread.sleep(Native Method)
        at java.lang.Thread.sleep(Thread.java:338)
        at org.apache.lucene.store.RateLimiter$SimpleRateLimiter.pause(RateLimiter.java:111)
        at org.apache.lucene.store.RateLimitedIndexOutput.flushBuffer(RateLimitedIndexOutput.java:45)
        at org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:90)
        at org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:79)
        at org.apache.lucene.store.RateLimitedIndexOutput.flush(RateLimitedIndexOutput.java:69)
        at org.apache.lucene.store.BufferedIndexOutput.close(BufferedIndexOutput.java:103)
        at org.apache.lucene.store.RateLimitedIndexOutput.close(RateLimitedIndexOutput.java:78)
        at org.apache.lucene.store.ChecksumIndexOutput.close(ChecksumIndexOutput.java:61)
        at org.apache.lucene.util.IOUtils.closeWhileHandlingException(IOUtils.java:203)
        at org.apache.lucene.index.SegmentInfos.rollbackCommit(SegmentInfos.java:853)
        at org.apache.lucene.index.SegmentInfos.finishCommit(SegmentInfos.java:932)
        at org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:2826)
        at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2815)
        at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2788)
        at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:529)
        at org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:95)
        at org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:64)
        at org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit(DistributedUpdateProcessor.java:1041)
        at org.apache.solr.update.processor.LogUpdateProcessor.processCommit(LogUpdateProcessorFactory.java:157)
        at org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandlerUtils.java:69)
        at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:146)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1819)
        at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:458)
        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:279)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:116)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
        at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
        at org.eclipse.jetty.server.Server.handle(Server.java:365)
        at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
        at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
        at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)
        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
        at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
        at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
        at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
        at java.lang.Thread.run(Thread.java:722)
   4) Thread[id=1368, name=searcherExecutor-757-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:722)
	at __randomizedtesting.SeedInfo.seed([C86105B07D04D6DF]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ShardRoutingTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=1357, name=qtp29204452-1357, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at java.lang.Thread.sleep(Thread.java:338)         at org.apache.lucene.store.RateLimiter$SimpleRateLimiter.pause(RateLimiter.java:111)         at org.apache.lucene.store.RateLimitedIndexOutput.flushBuffer(RateLimitedIndexOutput.java:45)         at org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:90)         at org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:79)         at org.apache.lucene.store.RateLimitedIndexOutput.flush(RateLimitedIndexOutput.java:69)         at org.apache.lucene.store.BufferedIndexOutput.close(BufferedIndexOutput.java:103)         at org.apache.lucene.store.RateLimitedIndexOutput.close(RateLimitedIndexOutput.java:78)         at org.apache.lucene.store.ChecksumIndexOutput.close(ChecksumIndexOutput.java:61)         at org.apache.lucene.util.IOUtils.closeWhileHandlingException(IOUtils.java:203)         at org.apache.lucene.index.SegmentInfos.rollbackCommit(SegmentInfos.java:853)         at org.apache.lucene.index.SegmentInfos.finishCommit(SegmentInfos.java:932)         at org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:2826)         at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2815)         at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:966)         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:830)         at org.apache.solr.update.SolrIndexWriter.close(SolrIndexWriter.java:145)         at org.apache.solr.update.DirectUpdateHandler2.closeWriter(DirectUpdateHandler2.java:730)         at org.apache.solr.update.DefaultSolrCoreState.closeIndexWriter(DefaultSolrCoreState.java:64)         at org.apache.solr.update.DefaultSolrCoreState.close(DefaultSolrCoreState.java:272)         at org.apache.solr.core.SolrCore.decrefSolrCoreState(SolrCore.java:883)         at org.apache.solr.core.SolrCore.close(SolrCore.java:975)         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:308)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)         at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:116)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)         at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)         at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)         at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)         at org.eclipse.jetty.server.Server.handle(Server.java:365)         at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)         at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)         at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)         at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:722)    2) Thread[id=1368, name=searcherExecutor-757-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)         at java.lang.Thread.run(Thread.java:722)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=1357, name=qtp29204452-1357, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]
        at java.lang.Thread.sleep(Native Method)
        at java.lang.Thread.sleep(Thread.java:338)
        at org.apache.lucene.store.RateLimiter$SimpleRateLimiter.pause(RateLimiter.java:111)
        at org.apache.lucene.store.RateLimitedIndexOutput.flushBuffer(RateLimitedIndexOutput.java:45)
        at org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:90)
        at org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:79)
        at org.apache.lucene.store.RateLimitedIndexOutput.flush(RateLimitedIndexOutput.java:69)
        at org.apache.lucene.store.BufferedIndexOutput.close(BufferedIndexOutput.java:103)
        at org.apache.lucene.store.RateLimitedIndexOutput.close(RateLimitedIndexOutput.java:78)
        at org.apache.lucene.store.ChecksumIndexOutput.close(ChecksumIndexOutput.java:61)
        at org.apache.lucene.util.IOUtils.closeWhileHandlingException(IOUtils.java:203)
        at org.apache.lucene.index.SegmentInfos.rollbackCommit(SegmentInfos.java:853)
        at org.apache.lucene.index.SegmentInfos.finishCommit(SegmentInfos.java:932)
        at org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:2826)
        at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2815)
        at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:966)
        at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
        at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:830)
        at org.apache.solr.update.SolrIndexWriter.close(SolrIndexWriter.java:145)
        at org.apache.solr.update.DirectUpdateHandler2.closeWriter(DirectUpdateHandler2.java:730)
        at org.apache.solr.update.DefaultSolrCoreState.closeIndexWriter(DefaultSolrCoreState.java:64)
        at org.apache.solr.update.DefaultSolrCoreState.close(DefaultSolrCoreState.java:272)
        at org.apache.solr.core.SolrCore.decrefSolrCoreState(SolrCore.java:883)
        at org.apache.solr.core.SolrCore.close(SolrCore.java:975)
        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:308)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:116)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
        at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
        at org.eclipse.jetty.server.Server.handle(Server.java:365)
        at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
        at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
        at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)
        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
        at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
        at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
        at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
        at java.lang.Thread.run(Thread.java:722)
   2) Thread[id=1368, name=searcherExecutor-757-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:722)
	at __randomizedtesting.SeedInfo.seed([C86105B07D04D6DF]:0)




Build Log:
[...truncated 8789 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardRoutingTest
[junit4:junit4]   2> 0 T1325 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4]   2> 4 T1325 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-ShardRoutingTest-1355788516961
[junit4:junit4]   2> 6 T1325 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 7 T1326 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 10 T1326 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 10 T1326 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 10 T1326 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 11 T1326 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 12 T1326 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\zookeeper\server1\data\version-2\snapshot.0
[junit4:junit4]   2> 108 T1325 oasc.ZkTestServer.run start zk server on port:63821
[junit4:junit4]   2> 109 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@9b07ed
[junit4:junit4]   2> 111 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 113 T1331 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 114 T1331 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
[junit4:junit4]   2> 114 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63824
[junit4:junit4]   2> 115 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63824
[junit4:junit4]   2> 116 T1329 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 149 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a0000 with negotiated timeout 10000 for client /127.0.0.1:63824
[junit4:junit4]   2> 149 T1331 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a0000, negotiated timeout = 10000
[junit4:junit4]   2> 150 T1332 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9b07ed name:ZooKeeperConnection Watcher:127.0.0.1:63821 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 151 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 152 T1325 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 162 T1330 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bab4afe6a0000
[junit4:junit4]   2> 166 T1327 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:63824 which had sessionid 0x13bab4afe6a0000
[junit4:junit4]   2> 166 T1332 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 166 T1325 oaz.ZooKeeper.close Session: 0x13bab4afe6a0000 closed
[junit4:junit4]   2> 167 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@f68ca5
[junit4:junit4]   2> 170 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 171 T1333 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 172 T1333 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
[junit4:junit4]   2> 172 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63827
[junit4:junit4]   2> 173 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63827
[junit4:junit4]   2> 176 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a0001 with negotiated timeout 10000 for client /127.0.0.1:63827
[junit4:junit4]   2> 176 T1333 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a0001, negotiated timeout = 10000
[junit4:junit4]   2> 177 T1334 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f68ca5 name:ZooKeeperConnection Watcher:127.0.0.1:63821/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 178 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 178 T1325 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 192 T1325 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 201 T1325 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 210 T1325 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 223 T1325 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 225 T1325 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 248 T1325 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 249 T1325 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 254 T1325 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 254 T1325 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 259 T1325 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 259 T1325 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 265 T1325 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 265 T1325 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 270 T1325 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 271 T1325 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 276 T1325 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 276 T1325 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 282 T1325 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 282 T1325 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 287 T1325 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 288 T1325 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 294 T1330 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bab4afe6a0001
[junit4:junit4]   2> 295 T1327 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:63827 which had sessionid 0x13bab4afe6a0001
[junit4:junit4]   2> 296 T1334 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 296 T1325 oaz.ZooKeeper.close Session: 0x13bab4afe6a0001 closed
[junit4:junit4]   2> 633 T1325 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 640 T1325 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63828
[junit4:junit4]   2> 641 T1325 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 641 T1325 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252
[junit4:junit4]   2> 642 T1325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252\'
[junit4:junit4]   2> 678 T1325 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 678 T1325 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 678 T1325 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252
[junit4:junit4]   2> 679 T1325 oasc.CoreContainer$Initializer.initialize looking for solr.xml: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252\solr.xml
[junit4:junit4]   2> 679 T1325 oasc.CoreContainer.<init> New CoreContainer 17350458
[junit4:junit4]   2> 680 T1325 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252\'
[junit4:junit4]   2> 680 T1325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252\'
[junit4:junit4]   2> 706 T1325 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 706 T1325 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 707 T1325 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 707 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 707 T1325 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 708 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 708 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 708 T1325 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 709 T1325 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 709 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 724 T1325 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 744 T1325 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:63821/solr
[junit4:junit4]   2> 744 T1325 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 745 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@14458a1
[junit4:junit4]   2> 746 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 747 T1344 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 748 T1344 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
[junit4:junit4]   2> 749 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63833
[junit4:junit4]   2> 749 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63833
[junit4:junit4]   2> 758 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a0002 with negotiated timeout 20000 for client /127.0.0.1:63833
[junit4:junit4]   2> 758 T1344 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a0002, negotiated timeout = 20000
[junit4:junit4]   2> 759 T1345 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14458a1 name:ZooKeeperConnection Watcher:127.0.0.1:63821 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 759 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 761 T1330 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bab4afe6a0002
[junit4:junit4]   2> 763 T1345 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 763 T1327 oazs.NIOServerCnxn.doIO WARNING caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13bab4afe6a0002, likely client has closed socket
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 763 T1325 oaz.ZooKeeper.close Session: 0x13bab4afe6a0002 closed
[junit4:junit4]   2> 765 T1327 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:63833 which had sessionid 0x13bab4afe6a0002
[junit4:junit4]   2> 765 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 774 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@ae1edd
[junit4:junit4]   2> 776 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 779 T1346 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 780 T1346 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
[junit4:junit4]   2> 780 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63836
[junit4:junit4]   2> 780 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63836
[junit4:junit4]   2> 783 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a0003 with negotiated timeout 20000 for client /127.0.0.1:63836
[junit4:junit4]   2> 783 T1346 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a0003, negotiated timeout = 20000
[junit4:junit4]   2> 784 T1347 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ae1edd name:ZooKeeperConnection Watcher:127.0.0.1:63821/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 785 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 788 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 791 T1325 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 794 T1325 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63828_
[junit4:junit4]   2> 795 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:63828_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:63828_
[junit4:junit4]   2> 795 T1325 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63828_
[junit4:junit4]   2> 800 T1325 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 809 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 811 T1325 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 815 T1325 oasc.Overseer.start Overseer (id=88852956248145923-127.0.0.1:63828_-n_0000000000) starting
[junit4:junit4]   2> 816 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 818 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 820 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 822 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 824 T1349 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 825 T1325 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 832 T1325 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 837 T1348 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 844 T1350 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252\collection1
[junit4:junit4]   2> 844 T1350 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 846 T1350 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 847 T1350 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 850 T1350 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252\collection1\'
[junit4:junit4]   2> 852 T1350 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 854 T1350 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252/collection1/lib/README' to classloader
[junit4:junit4]   2> 922 T1350 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 994 T1350 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 996 T1350 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 1000 T1350 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1601 T1350 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1605 T1350 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1637 T1350 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252\collection1\, dataDir=.\org.apache.solr.cloud.ShardRoutingTest-1355788516960/control/data\
[junit4:junit4]   2> 1637 T1350 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d35dc5
[junit4:junit4]   2> 1638 T1350 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 1639 T1350 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\control\data forceNew:false
[junit4:junit4]   2> 1640 T1350 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\control\data
[junit4:junit4]   2> 1640 T1350 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ShardRoutingTest-1355788516960/control/data\index/
[junit4:junit4]   2> 1641 T1350 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\control\data\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1641 T1350 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\control\data\index forceNew:false
[junit4:junit4]   2> 1654 T1350 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ShardRoutingTest-1355788516960\control\data\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1539688; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1654 T1350 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1656 T1350 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\control\data\index
[junit4:junit4]   2> 1656 T1350 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1657 T1350 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1658 T1350 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1658 T1350 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1658 T1350 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1659 T1350 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1659 T1350 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1659 T1350 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1660 T1350 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1661 T1350 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1661 T1350 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1662 T1350 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1662 T1350 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1663 T1350 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1663 T1350 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1663 T1350 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1664 T1350 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1665 T1350 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1665 T1350 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1666 T1350 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1666 T1350 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1667 T1350 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1668 T1350 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1668 T1350 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1669 T1350 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1670 T1350 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1670 T1350 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1680 T1350 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1685 T1350 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1687 T1350 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1690 T1350 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\control\data
[junit4:junit4]   2> 1691 T1350 oass.SolrIndexSearcher.<init> Opening Searcher@53f819 main
[junit4:junit4]   2> 1693 T1350 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1693 T1350 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1694 T1350 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1704 T1350 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1769 T1351 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@53f819 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1772 T1350 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1772 T1350 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1773 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:create cxid:0x5f zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1847 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1849 T1348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:63828_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:63828"}
[junit4:junit4]   2> 1849 T1348 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 1850 T1348 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 1851 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:create cxid:0x67 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 1875 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2279 T1350 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2279 T1350 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:63828 shardId:shard1
[junit4:junit4]   2> 2281 T1350 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 2306 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:delete cxid:0x81 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2310 T1350 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2311 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:create cxid:0x82 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2319 T1350 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2320 T1350 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2321 T1350 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:63828/collection1/
[junit4:junit4]   2> 2321 T1350 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2322 T1350 oasc.SyncStrategy.syncToMe http://127.0.0.1:63828/collection1/ has no replicas
[junit4:junit4]   2> 2322 T1350 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:63828/collection1/
[junit4:junit4]   2> 2322 T1350 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 2337 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:create cxid:0x8c zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2387 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2419 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2448 T1350 oasc.ZkController.register We are http://127.0.0.1:63828/collection1/ and leader is http://127.0.0.1:63828/collection1/
[junit4:junit4]   2> 2448 T1350 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:63828
[junit4:junit4]   2> 2448 T1350 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 2449 T1350 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 2449 T1350 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2455 T1350 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2458 T1325 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 2459 T1325 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2459 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2478 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 2482 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@ce3abc
[junit4:junit4]   2> 2484 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2485 T1352 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2485 T1352 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
[junit4:junit4]   2> 2486 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63839
[junit4:junit4]   2> 2486 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63839
[junit4:junit4]   2> 2488 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a0004 with negotiated timeout 10000 for client /127.0.0.1:63839
[junit4:junit4]   2> 2488 T1352 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a0004, negotiated timeout = 10000
[junit4:junit4]   2> 2489 T1353 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ce3abc name:ZooKeeperConnection Watcher:127.0.0.1:63821/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2489 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2490 T1325 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2493 T1325 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 2814 T1325 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 2818 T1325 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63840
[junit4:junit4]   2> 2819 T1325 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2820 T1325 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449
[junit4:junit4]   2> 2820 T1325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449\'
[junit4:junit4]   2> 2859 T1325 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2860 T1325 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2860 T1325 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449
[junit4:junit4]   2> 2860 T1325 oasc.CoreContainer$Initializer.initialize looking for solr.xml: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449\solr.xml
[junit4:junit4]   2> 2861 T1325 oasc.CoreContainer.<init> New CoreContainer 31985776
[junit4:junit4]   2> 2861 T1325 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449\'
[junit4:junit4]   2> 2862 T1325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449\'
[junit4:junit4]   2> 2886 T1325 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 2887 T1325 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2887 T1325 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 2888 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2888 T1325 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2888 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2889 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2889 T1325 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2889 T1325 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2890 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 2903 T1325 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2924 T1325 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:63821/solr
[junit4:junit4]   2> 2925 T1325 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2925 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@12fffa6
[junit4:junit4]   2> 2927 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2927 T1363 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2928 T1363 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
[junit4:junit4]   2> 2928 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63845
[junit4:junit4]   2> 2928 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63845
[junit4:junit4]   2> 2941 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a0005 with negotiated timeout 20000 for client /127.0.0.1:63845
[junit4:junit4]   2> 2941 T1363 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a0005, negotiated timeout = 20000
[junit4:junit4]   2> 2942 T1364 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12fffa6 name:ZooKeeperConnection Watcher:127.0.0.1:63821 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2942 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2945 T1330 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bab4afe6a0005
[junit4:junit4]   2> 2947 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2947 T1327 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:63845 which had sessionid 0x13bab4afe6a0005
[junit4:junit4]   2> 2948 T1364 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2948 T1325 oaz.ZooKeeper.close Session: 0x13bab4afe6a0005 closed
[junit4:junit4]   2> 2949 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 2950 T1348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:63828_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:63828"}
[junit4:junit4]   2> 2955 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@17b90b
[junit4:junit4]   2> 2958 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2958 T1365 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2959 T1365 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
[junit4:junit4]   2> 2959 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2959 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63848
[junit4:junit4]   2> 2960 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63848
[junit4:junit4]   2> 2959 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2962 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a0006 with negotiated timeout 20000 for client /127.0.0.1:63848
[junit4:junit4]   2> 2962 T1365 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a0006, negotiated timeout = 20000
[junit4:junit4]   2> 2962 T1366 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17b90b name:ZooKeeperConnection Watcher:127.0.0.1:63821/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2963 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2966 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0006 type:create cxid:0x1 zxid:0x4d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2969 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0006 type:create cxid:0x2 zxid:0x4e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2971 T1325 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63840_
[junit4:junit4]   2> 2972 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0006 type:delete cxid:0x4 zxid:0x4f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:63840_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:63840_
[junit4:junit4]   2> 2974 T1325 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63840_
[junit4:junit4]   2> 2978 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2979 T1353 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2979 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 2981 T1347 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2985 T1325 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2994 T1367 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449\collection1
[junit4:junit4]   2> 2995 T1367 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2995 T1367 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2996 T1367 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2998 T1367 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449\collection1\'
[junit4:junit4]   2> 3000 T1367 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3001 T1367 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449/collection1/lib/README' to classloader
[junit4:junit4]   2> 3064 T1367 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 3134 T1367 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3136 T1367 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3141 T1367 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 3775 T1367 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 3778 T1367 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3810 T1367 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449\collection1\, dataDir=.\org.apache.solr.cloud.ShardRoutingTest-1355788516960/jetty1\
[junit4:junit4]   2> 3811 T1367 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d35dc5
[junit4:junit4]   2> 3811 T1367 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 3812 T1367 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty1 forceNew:false
[junit4:junit4]   2> 3813 T1367 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty1
[junit4:junit4]   2> 3813 T1367 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ShardRoutingTest-1355788516960/jetty1\index/
[junit4:junit4]   2> 3814 T1367 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty1\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3815 T1367 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty1\index forceNew:false
[junit4:junit4]   2> 3828 T1367 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a57753; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3828 T1367 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3830 T1367 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty1\index
[junit4:junit4]   2> 3830 T1367 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 3833 T1367 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 3833 T1367 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 3834 T1367 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 3834 T1367 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 3835 T1367 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 3835 T1367 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 3835 T1367 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 3836 T1367 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 3837 T1367 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 3837 T1367 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 3838 T1367 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 3838 T1367 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 3839 T1367 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 3839 T1367 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 3839 T1367 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 3840 T1367 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3840 T1367 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3849 T1367 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3850 T1367 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3850 T1367 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3851 T1367 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3852 T1367 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3852 T1367 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3853 T1367 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3855 T1367 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 3855 T1367 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 3867 T1367 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3872 T1367 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 3874 T1367 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 3876 T1367 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty1
[junit4:junit4]   2> 3878 T1367 oass.SolrIndexSearcher.<init> Opening Searcher@11dad60 main
[junit4:junit4]   2> 3880 T1367 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3880 T1367 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3880 T1367 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 3892 T1367 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 3959 T1368 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@11dad60 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 3962 T1367 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 3962 T1367 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3974 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3975 T1348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"4",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:63840_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:63840"}
[junit4:junit4]   2> 3975 T1348 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 4
[junit4:junit4]   2> 3976 T1348 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 3987 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 3987 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 3987 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 4466 T1367 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 4466 T1367 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:63840 shardId:shard1
[junit4:junit4]   2> 4468 T1367 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 4494 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0006 type:delete cxid:0x4f zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 4498 T1367 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 4501 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0006 type:create cxid:0x50 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4509 T1367 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 4509 T1367 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 4510 T1367 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:63840/collection1/
[junit4:junit4]   2> 4510 T1367 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 4510 T1367 oasc.SyncStrategy.syncToMe http://127.0.0.1:63840/collection1/ has no replicas
[junit4:junit4]   2> 4511 T1367 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:63840/collection1/
[junit4:junit4]   2> 4512 T1367 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 4527 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0006 type:create cxid:0x5a zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5010 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5043 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5043 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5043 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5097 T1367 oasc.ZkController.register We are http://127.0.0.1:63840/collection1/ and leader is http://127.0.0.1:63840/collection1/
[junit4:junit4]   2> 5097 T1367 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:63840
[junit4:junit4]   2> 5097 T1367 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 5097 T1367 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 5097 T1367 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5103 T1367 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5106 T1325 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 5107 T1325 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 5107 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5440 T1325 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 5443 T1325 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63849
[junit4:junit4]   2> 5444 T1325 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5445 T1325 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086
[junit4:junit4]   2> 5445 T1325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086\'
[junit4:junit4]   2> 5482 T1325 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 5482 T1325 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5482 T1325 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086
[junit4:junit4]   2> 5484 T1325 oasc.CoreContainer$Initializer.initialize looking for solr.xml: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086\solr.xml
[junit4:junit4]   2> 5484 T1325 oasc.CoreContainer.<init> New CoreContainer 14806450
[junit4:junit4]   2> 5485 T1325 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086\'
[junit4:junit4]   2> 5485 T1325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086\'
[junit4:junit4]   2> 5508 T1325 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 5509 T1325 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5510 T1325 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 5510 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5511 T1325 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5511 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5512 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5512 T1325 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5512 T1325 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5513 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 5527 T1325 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 5545 T1325 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:63821/solr
[junit4:junit4]   2> 5545 T1325 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 5546 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4df7d9
[junit4:junit4]   2> 5548 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5549 T1378 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5549 T1378 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
[junit4:junit4]   2> 5549 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63854
[junit4:junit4]   2> 5550 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63854
[junit4:junit4]   2> 5560 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a0007 with negotiated timeout 20000 for client /127.0.0.1:63854
[junit4:junit4]   2> 5560 T1378 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a0007, negotiated timeout = 20000
[junit4:junit4]   2> 5561 T1379 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4df7d9 name:ZooKeeperConnection Watcher:127.0.0.1:63821 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5561 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5564 T1330 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bab4afe6a0007
[junit4:junit4]   2> 5566 T1327 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:63854 which had sessionid 0x13bab4afe6a0007
[junit4:junit4]   2> 5566 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5566 T1325 oaz.ZooKeeper.close Session: 0x13bab4afe6a0007 closed
[junit4:junit4]   2> 5567 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 5567 T1379 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 5569 T1348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"4",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:63840_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:63840"}
[junit4:junit4]   2> 5572 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ba381e
[junit4:junit4]   2> 5575 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5576 T1380 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5577 T1380 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
[junit4:junit4]   2> 5577 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63857
[junit4:junit4]   2> 5578 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63857
[junit4:junit4]   2> 5579 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5579 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5579 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5581 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a0008 with negotiated timeout 20000 for client /127.0.0.1:63857
[junit4:junit4]   2> 5581 T1380 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a0008, negotiated timeout = 20000
[junit4:junit4]   2> 5581 T1381 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ba381e name:ZooKeeperConnection Watcher:127.0.0.1:63821/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5581 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5583 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0008 type:create cxid:0x1 zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5586 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0008 type:create cxid:0x2 zxid:0x71 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5591 T1325 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63849_
[junit4:junit4]   2> 5600 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0008 type:delete cxid:0x4 zxid:0x73 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:63849_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:63849_
[junit4:junit4]   2> 5608 T1325 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63849_
[junit4:junit4]   2> 5612 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5613 T1366 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 5614 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 5614 T1353 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 5614 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 5618 T1347 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 5622 T1325 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5632 T1382 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086\collection1
[junit4:junit4]   2> 5632 T1382 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5634 T1382 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5634 T1382 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5637 T1382 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086\collection1\'
[junit4:junit4]   2> 5639 T1382 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5641 T1382 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086/collection1/lib/README' to classloader
[junit4:junit4]   2> 5703 T1382 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 5768 T1382 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5769 T1382 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5774 T1382 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 6337 T1382 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 6341 T1382 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 6379 T1382 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086\collection1\, dataDir=.\org.apache.solr.cloud.ShardRoutingTest-1355788516960/jetty2\
[junit4:junit4]   2> 6380 T1382 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d35dc5
[junit4:junit4]   2> 6380 T1382 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 6382 T1382 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty2 forceNew:false
[junit4:junit4]   2> 6382 T1382 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty2
[junit4:junit4]   2> 6382 T1382 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ShardRoutingTest-1355788516960/jetty2\index/
[junit4:junit4]   2> 6383 T1382 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty2\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 6383 T1382 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty2\index forceNew:false
[junit4:junit4]   2> 6393 T1382 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty2\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1aa0129; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 6393 T1382 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 6395 T1382 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty2\index
[junit4:junit4]   2> 6395 T1382 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 6398 T1382 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 6398 T1382 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 6398 T1382 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 6398 T1382 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 6400 T1382 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 6400 T1382 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 6401 T1382 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 6401 T1382 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 6402 T1382 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 6403 T1382 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 6404 T1382 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 6404 T1382 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 6404 T1382 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 6404 T1382 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 6405 T1382 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 6406 T1382 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 6407 T1382 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6407 T1382 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6408 T1382 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6409 T1382 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6410 T1382 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6410 T1382 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6411 T1382 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6412 T1382 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6413 T1382 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 6413 T1382 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 6424 T1382 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 6429 T1382 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 6430 T1382 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 6433 T1382 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty2
[junit4:junit4]   2> 6435 T1382 oass.SolrIndexSearcher.<init> Opening Searcher@e594a2 main
[junit4:junit4]   2> 6436 T1382 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 6437 T1382 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 6437 T1382 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 6448 T1382 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 6504 T1382 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 6505 T1382 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6506 T1383 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e594a2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 6619 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6620 T1348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"4",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:63849_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:63849"}
[junit4:junit4]   2> 6620 T1348 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=4
[junit4:junit4]   2> 6620 T1348 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 6628 T1381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 6628 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 6629 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 6630 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7008 T1382 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 7008 T1382 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:63849 shardId:shard2
[junit4:junit4]   2> 7009 T1382 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 7022 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0008 type:delete cxid:0x4e zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 7024 T1382 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 7024 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0008 type:create cxid:0x4f zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7028 T1382 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 7028 T1382 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 7028 T1382 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:63849/collection1/
[junit4:junit4]   2> 7028 T1382 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 7029 T1382 oasc.SyncStrategy.syncToMe http://127.0.0.1:63849/collection1/ has no replicas
[junit4:junit4]   2> 7029 T1382 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:63849/collection1/
[junit4:junit4]   2> 7029 T1382 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 7035 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0008 type:create cxid:0x58 zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7140 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7179 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7179 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7180 T1381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7182 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7191 T1382 oasc.ZkController.register We are http://127.0.0.1:63849/collection1/ and leader is http://127.0.0.1:63849/collection1/
[junit4:junit4]   2> 7191 T1382 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:63849
[junit4:junit4]   2> 7191 T1382 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 7191 T1382 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 7191 T1382 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7195 T1382 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7196 T1325 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 7196 T1325 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 7197 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7527 T1325 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 7532 T1325 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63858
[junit4:junit4]   2> 7533 T1325 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 7533 T1325 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163
[junit4:junit4]   2> 7534 T1325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163\'
[junit4:junit4]   2> 7569 T1325 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 7570 T1325 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 7570 T1325 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163
[junit4:junit4]   2> 7571 T1325 oasc.CoreContainer$Initializer.initialize looking for solr.xml: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163\solr.xml
[junit4:junit4]   2> 7571 T1325 oasc.CoreContainer.<init> New CoreContainer 6943436
[junit4:junit4]   2> 7572 T1325 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163\'
[junit4:junit4]   2> 7572 T1325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163\'
[junit4:junit4]   2> 7596 T1325 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 7597 T1325 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 7598 T1325 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 7598 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 7598 T1325 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 7599 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 7599 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 7599 T1325 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 7600 T1325 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 7600 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 7614 T1325 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 7633 T1325 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:63821/solr
[junit4:junit4]   2> 7633 T1325 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 7633 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@de54be
[junit4:junit4]   2> 7636 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7637 T1393 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7637 T1393 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
[junit4:junit4]   2> 7638 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63863
[junit4:junit4]   2> 7638 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63863
[junit4:junit4]   2> 7651 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a0009 with negotiated timeout 20000 for client /127.0.0.1:63863
[junit4:junit4]   2> 7651 T1393 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a0009, negotiated timeout = 20000
[junit4:junit4]   2> 7652 T1394 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@de54be name:ZooKeeperConnection Watcher:127.0.0.1:63821 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7652 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7654 T1330 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bab4afe6a0009
[junit4:junit4]   2> 7655 T1327 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:63863 which had sessionid 0x13bab4afe6a0009
[junit4:junit4]   2> 7656 T1325 oaz.ZooKeeper.close Session: 0x13bab4afe6a0009 closed
[junit4:junit4]   2> 7656 T1394 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 7656 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 7662 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@384418
[junit4:junit4]   2> 7664 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7665 T1395 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7665 T1395 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
[junit4:junit4]   2> 7665 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63866
[junit4:junit4]   2> 7666 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63866
[junit4:junit4]   2> 7668 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a000a with negotiated timeout 20000 for client /127.0.0.1:63866
[junit4:junit4]   2> 7668 T1395 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a000a, negotiated timeout = 20000
[junit4:junit4]   2> 7668 T1396 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@384418 name:ZooKeeperConnection Watcher:127.0.0.1:63821/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7668 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7669 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a000a type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7670 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a000a type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7672 T1325 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63858_
[junit4:junit4]   2> 7673 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a000a type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:63858_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:63858_
[junit4:junit4]   2> 7674 T1325 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63858_
[junit4:junit4]   2> 7678 T1381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7678 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7680 T1353 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 7680 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 7680 T1366 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 7680 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 7682 T1381 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 7683 T1347 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 7687 T1325 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7694 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7706 T1348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"4",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:63849_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:63849"}
[junit4:junit4]   2> 7708 T1397 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163\collection1
[junit4:junit4]   2> 7709 T1397 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 7711 T1397 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 7711 T1397 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 7715 T1397 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163\collection1\'
[junit4:junit4]   2> 7717 T1397 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 7718 T1397 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163/collection1/lib/README' to classloader
[junit4:junit4]   2> 7727 T1381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 7728 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 7728 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 7728 T1396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 7735 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 7775 T1397 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 7846 T1397 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 7847 T1397 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 7853 T1397 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 8468 T1397 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 8472 T1397 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 8509 T1397 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163\collection1\, dataDir=.\org.apache.solr.cloud.ShardRoutingTest-1355788516960/jetty3\
[junit4:junit4]   2> 8510 T1397 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d35dc5
[junit4:junit4]   2> 8510 T1397 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 8511 T1397 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty3 forceNew:false
[junit4:junit4]   2> 8512 T1397 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty3
[junit4:junit4]   2> 8512 T1397 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ShardRoutingTest-1355788516960/jetty3\index/
[junit4:junit4]   2> 8513 T1397 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty3\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 8514 T1397 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty3\index forceNew:false
[junit4:junit4]   2> 8523 T1397 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty3\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@778ca2; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 8523 T1397 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 8525 T1397 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty3\index
[junit4:junit4]   2> 8525 T1397 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 8527 T1397 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 8527 T1397 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 8527 T1397 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 8528 T1397 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 8528 T1397 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 8528 T1397 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 8529 T1397 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 8529 T1397 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 8530 T1397 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 8531 T1397 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 8532 T1397 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 8532 T1397 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 8533 T1397 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 8533 T1397 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 8534 T1397 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 8535 T1397 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 8536 T1397 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8536 T1397 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8537 T1397 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8538 T1397 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8538 T1397 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8539 T1397 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8540 T1397 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8541 T1397 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8541 T1397 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 8542 T1397 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 8553 T1397 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 8558 T1397 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 8560 T1397 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 8562 T1397 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty3
[junit4:junit4]   2> 8564 T1397 oass.SolrIndexSearcher.<init> Opening Searcher@129810f main
[junit4:junit4]   2> 8566 T1397 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 8566 T1397 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 8567 T1397 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 8579 T1397 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 8674 T1398 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@129810f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 8678 T1397 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 8678 T1397 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8748 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8749 T1348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"4",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:63858_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:63858"}
[junit4:junit4]   2> 8750 T1348 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=4
[junit4:junit4]   2> 8750 T1348 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4:junit4]   2> 8759 T1381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 8759 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 8760 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 8761 T1396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 8762 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9182 T1397 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 9183 T1397 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:63858 shardId:shard3
[junit4:junit4]   2> 9185 T1397 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4:junit4]   2> 9207 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a000a type:delete cxid:0x50 zxid:0xa0 txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard3 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard3
[junit4:junit4]   2> 9210 T1397 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 9211 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a000a type:create cxid:0x51 zxid:0xa1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9219 T1397 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 9219 T1397 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 9221 T1397 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:63858/collection1/
[junit4:junit4]   2> 9221 T1397 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 9221 T1397 oasc.SyncStrategy.syncToMe http://127.0.0.1:63858/collection1/ has no replicas
[junit4:junit4]   2> 9222 T1397 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:63858/collection1/
[junit4:junit4]   2> 9222 T1397 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4:junit4]   2> 9234 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a000a type:create cxid:0x5a zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9276 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9308 T1381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9308 T1396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9309 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9309 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9310 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9344 T1397 oasc.ZkController.register We are http://127.0.0.1:63858/collection1/ and leader is http://127.0.0.1:63858/collection1/
[junit4:junit4]   2> 9344 T1397 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:63858
[junit4:junit4]   2> 9344 T1397 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 9344 T1397 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 9346 T1397 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9351 T1397 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9353 T1325 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 9355 T1325 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 9355 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9701 T1325 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 9706 T1325 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63867
[junit4:junit4]   2> 9707 T1325 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 9707 T1325 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331
[junit4:junit4]   2> 9707 T1325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331\'
[junit4:junit4]   2> 9749 T1325 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 9750 T1325 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 9750 T1325 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331
[junit4:junit4]   2> 9750 T1325 oasc.CoreContainer$Initializer.initialize looking for solr.xml: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331\solr.xml
[junit4:junit4]   2> 9751 T1325 oasc.CoreContainer.<init> New CoreContainer 18838579
[junit4:junit4]   2> 9751 T1325 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331\'
[junit4:junit4]   2> 9752 T1325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331\'
[junit4:junit4]   2> 9776 T1325 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 9776 T1325 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 9776 T1325 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 9777 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 9777 T1325 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 9778 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 9778 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 9778 T1325 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 9779 T1325 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 9779 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 9794 T1325 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 9827 T1325 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:63821/solr
[junit4:junit4]   2> 9828 T1325 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 9828 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@2ad05d
[junit4:junit4]   2> 9832 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9835 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9836 T1348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"4",
[junit4:junit4]   2> 	  "shard":"shard3",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:63858_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:63858"}
[junit4:junit4]   2> 9842 T1408 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 9843 T1408 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
[junit4:junit4]   2> 9844 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63872
[junit4:junit4]   2> 9844 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63872
[junit4:junit4]   2> 9893 T1408 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a000b, negotiated timeout = 20000
[junit4:junit4]   2> 9894 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a000b with negotiated timeout 20000 for client /127.0.0.1:63872
[junit4:junit4]   2> 9895 T1409 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ad05d name:ZooKeeperConnection Watcher:127.0.0.1:63821 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9895 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9900 T1330 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bab4afe6a000b
[junit4:junit4]   2> 9904 T1327 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:63872 which had sessionid 0x13bab4afe6a000b
[junit4:junit4]   2> 9905 T1325 oaz.ZooKeeper.close Session: 0x13bab4afe6a000b closed
[junit4:junit4]   2> 9905 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 9910 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@f60ab9
[junit4:junit4]   2> 9914 T1396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9914 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9915 T1409 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 9915 T1381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9915 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9916 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9916 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9923 T1410 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 9923 T1410 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
[junit4:junit4]   2> 9924 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63875
[junit4:junit4]   2> 9925 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63875
[junit4:junit4]   2> 9928 T1410 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a000c, negotiated timeout = 20000
[junit4:junit4]   2> 9928 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a000c with negotiated timeout 20000 for client /127.0.0.1:63875
[junit4:junit4]   2> 9928 T1411 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f60ab9 name:ZooKeeperConnection Watcher:127.0.0.1:63821/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9930 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9941 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a000c type:create cxid:0x1 zxid:0xb5 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9944 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a000c type:create cxid:0x2 zxid:0xb6 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9946 T1325 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63867_
[junit4:junit4]   2> 9947 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a000c type:delete cxid:0x4 zxid:0xb7 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:63867_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:63867_
[junit4:junit4]   2> 9948 T1325 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63867_
[junit4:junit4]   2> 9954 T1396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9954 T1381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9955 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9958 T1366 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 9958 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9959 T1353 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 9960 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 9965 T1396 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 9966 T1381 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 9967 T1347 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 9971 T1325 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 9980 T1412 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331\collection1
[junit4:junit4]   2> 9980 T1412 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 9982 T1412 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 9982 T1412 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 9984 T1412 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331\collection1\'
[junit4:junit4]   2> 9986 T1412 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 9987 T1412 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331/collection1/lib/README' to classloader
[junit4:junit4]   2> 10041 T1412 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 10119 T1412 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 10122 T1412 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 10126 T1412 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 10703 T1412 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 10707 T1412 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 10742 T1412 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331\collection1\, dataDir=.\org.apache.solr.cloud.ShardRoutingTest-1355788516960/jetty4\
[junit4:junit4]   2> 10742 T1412 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d35dc5
[junit4:junit4]   2> 10743 T1412 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 10744 T1412 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty4 forceNew:false
[junit4:junit4]   2> 10744 T1412 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty4
[junit4:junit4]   2> 10745 T1412 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ShardRoutingTest-1355788516960/jetty4\index/
[junit4:junit4]   2> 10746 T1412 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty4\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 10746 T1412 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty4\index forceNew:false
[junit4:junit4]   2> 10755 T1412 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty4\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@12e86ed; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10755 T1412 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 10757 T1412 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty4\index
[junit4:junit4]   2> 10757 T1412 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 10759 T1412 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 10759 T1412 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 10760 T1412 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 10760 T1412 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 10760 T1412 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 10761 T1412 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 10761 T1412 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 10762 T1412 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 10763 T1412 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 10763 T1412 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 10764 T1412 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 10764 T1412 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 10765 T1412 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 10765 T1412 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 10766 T1412 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 10766 T1412 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 10767 T1412 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10768 T1412 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10769 T1412 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10769 T1412 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10770 T1412 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10771 T1412 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10772 T1412 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10772 T1412 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10773 T1412 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 10774 T1412 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 10786 T1412 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 10791 T1412 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 10793 T1412 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 10795 T1412 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty4
[junit4:junit4]   2> 10796 T1412 oass.SolrIndexSearcher.<init> Opening Searcher@1946aa7 main
[junit4:junit4]   2> 10797 T1412 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 10798 T1412 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 10799 T1412 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 10809 T1412 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 10868 T1413 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1946aa7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 10873 T1412 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 10873 T1412 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 10973 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10975 T1348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"4",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:63867_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:63867"}
[junit4:junit4]   2> 10975 T1348 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=4
[junit4:junit4]   2> 10976 T1348 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard4
[junit4:junit4]   2> 10995 T1396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 10996 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 10997 T1411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 10999 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 11000 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstat

[...truncated too long message...]

tpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
[junit4:junit4]    >         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)
[junit4:junit4]    >         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4:junit4]    >         at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4:junit4]    >         at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4:junit4]    >         at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4:junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]    >    4) Thread[id=1368, name=searcherExecutor-757-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]
[junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([C86105B07D04D6DF]:0)
[junit4:junit4]    > Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4:junit4]    >    1) Thread[id=1357, name=qtp29204452-1357, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at java.lang.Thread.sleep(Thread.java:338)
[junit4:junit4]    >         at org.apache.lucene.store.RateLimiter$SimpleRateLimiter.pause(RateLimiter.java:111)
[junit4:junit4]    >         at org.apache.lucene.store.RateLimitedIndexOutput.flushBuffer(RateLimitedIndexOutput.java:45)
[junit4:junit4]    >         at org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:90)
[junit4:junit4]    >         at org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:79)
[junit4:junit4]    >         at org.apache.lucene.store.RateLimitedIndexOutput.flush(RateLimitedIndexOutput.java:69)
[junit4:junit4]    >         at org.apache.lucene.store.BufferedIndexOutput.close(BufferedIndexOutput.java:103)
[junit4:junit4]    >         at org.apache.lucene.store.RateLimitedIndexOutput.close(RateLimitedIndexOutput.java:78)
[junit4:junit4]    >         at org.apache.lucene.store.ChecksumIndexOutput.close(ChecksumIndexOutput.java:61)
[junit4:junit4]    >         at org.apache.lucene.util.IOUtils.closeWhileHandlingException(IOUtils.java:203)
[junit4:junit4]    >         at org.apache.lucene.index.SegmentInfos.rollbackCommit(SegmentInfos.java:853)
[junit4:junit4]    >         at org.apache.lucene.index.SegmentInfos.finishCommit(SegmentInfos.java:932)
[junit4:junit4]    >         at org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:2826)
[junit4:junit4]    >         at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2815)
[junit4:junit4]    >         at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:966)
[junit4:junit4]    >         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
[junit4:junit4]    >         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:830)
[junit4:junit4]    >         at org.apache.solr.update.SolrIndexWriter.close(SolrIndexWriter.java:145)
[junit4:junit4]    >         at org.apache.solr.update.DirectUpdateHandler2.closeWriter(DirectUpdateHandler2.java:730)
[junit4:junit4]    >         at org.apache.solr.update.DefaultSolrCoreState.closeIndexWriter(DefaultSolrCoreState.java:64)
[junit4:junit4]    >         at org.apache.solr.update.DefaultSolrCoreState.close(DefaultSolrCoreState.java:272)
[junit4:junit4]    >         at org.apache.solr.core.SolrCore.decrefSolrCoreState(SolrCore.java:883)
[junit4:junit4]    >         at org.apache.solr.core.SolrCore.close(SolrCore.java:975)
[junit4:junit4]    >         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:308)
[junit4:junit4]    >         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4]    >         at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:116)
[junit4:junit4]    >         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4]    >         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
[junit4:junit4]    >         at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4:junit4]    >         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4:junit4]    >         at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
[junit4:junit4]    >         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
[junit4:junit4]    >         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
[junit4:junit4]    >         at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4:junit4]    >         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
[junit4:junit4]    >         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4:junit4]    >         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4:junit4]    >         at org.eclipse.jetty.server.Server.handle(Server.java:365)
[junit4:junit4]    >         at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
[junit4:junit4]    >         at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
[junit4:junit4]    >         at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
[junit4:junit4]    >         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)
[junit4:junit4]    >         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4:junit4]    >         at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4:junit4]    >         at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4:junit4]    >         at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4:junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]    >    2) Thread[id=1368, name=searcherExecutor-757-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]
[junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([C86105B07D04D6DF]:0)
[junit4:junit4] Completed in 411.58s, 1 test, 2 failures, 2 errors <<< FAILURES!

[...truncated 553 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:353: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:178: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:438: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1175: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:840: There were test failures: 243 suites, 1010 tests, 3 suite-level errors, 1 failure, 699 ignored

Total time: 34 minutes 24 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.7.0_09 -server -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure



Re: [JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_09) - Build # 2203 - Failure!

Posted by Mark Miller <ma...@gmail.com>.
The rate limited dir is not random - its being used in most tests as most tests use the std solrconfig.xml - it's hard coded but it's just using really high values with the idea it would not do any limiting. This was done so I could see it didn't have a bad affect and test that the settings matched what was in the config.

The settings are so high I don't think it should ever be sleeping like it is.

- Mark

On Dec 17, 2012, at 10:45 PM, Yonik Seeley <yo...@lucidworks.com> wrote:

> This test only brings servers up at the beginning and that's it (i.e.
> any "recovery" would be of an empty index).
> 
> It feels like we're throwing too many random elements into higher
> level tests here - introducing too many variables at once (i.e. the
> random Directory implementations).
> 
> -Yonik
> http://lucidworks.com
> 
> 
> On Mon, Dec 17, 2012 at 7:57 PM, Mark Miller <ma...@gmail.com> wrote:
>> These are the MB/s values I have - I didn't think they would kick in during our tests?
>> 
>>    <double name="maxWriteMBPerSecDefault">1000000</double>
>>    <double name="maxWriteMBPerSecFlush">2000000</double>
>>    <double name="maxWriteMBPerSecMerge">3000000</double>
>>    <double name="maxWriteMBPerSecRead">4000000</double>
>> 
>> Mark
>> 
>> On Dec 17, 2012, at 7:35 PM, Mark Miller <ma...@gmail.com> wrote:
>> 
>>> 
>>> On Dec 17, 2012, at 7:31 PM, Mark Miller <ma...@gmail.com> wrote:
>>> 
>>>> Socket read timeouts. I'll raise it for this case.
>>> 
>>> Nevermind - it's already at 60 seconds. What's odd is that the commit is taking that long.
>>> 
>>> One of the threads is waiting in the rate limiter - which is weird - I thought I put it absurdly high for tests. I'll dig into it when I get a chance:
>>> 
>>> [junit4:junit4]   1> Thread[qtp29204452-1358,5,TGRP-ShardRoutingTest]
>>> [junit4:junit4]   1> java.lang.Thread.sleep(Native Method)
>>> [junit4:junit4]   1> java.lang.Thread.sleep(Thread.java:338)
>>> [junit4:junit4]   1> org.apache.lucene.store.RateLimiter$SimpleRateLimiter.pause(RateLimiter.java:111)
>>> [junit4:junit4]   1> org.apache.lucene.store.RateLimitedIndexOutput.flushBuffer(RateLimitedIndexOutput.java:45)
>>> [junit4:junit4]   1> org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:90)
>>> [junit4:junit4]   1> org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:79)
>>> [junit4:junit4]   1> org.apache.lucene.store.RateLimitedIndexOutput.flush(RateLimitedIndexOutput.java:69)
>>> [junit4:junit4]   1> org.apache.lucene.store.BufferedIndexOutput.close(BufferedIndexOutput.java:103)
>>> [junit4:junit4]   1> org.apache.lucene.store.RateLimitedIndexOutput.close(RateLimitedIndexOutput.java:78)
>>> [junit4:junit4]   1> org.apache.lucene.store.ChecksumIndexOutput.close(ChecksumIndexOutput.java:61)
>>> [junit4:junit4]   1> org.apache.lucene.index.SegmentInfos.finishCommit(SegmentInfos.java:927)
>>> [junit4:junit4]   1> org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:2826)
>>> [junit4:junit4]   1> org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2815)
>>> [junit4:junit4]   1> org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2788)
>> 
>> 
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: [JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_09) - Build # 2203 - Failure!

Posted by Yonik Seeley <yo...@lucidworks.com>.
This test only brings servers up at the beginning and that's it (i.e.
any "recovery" would be of an empty index).

It feels like we're throwing too many random elements into higher
level tests here - introducing too many variables at once (i.e. the
random Directory implementations).

-Yonik
http://lucidworks.com


On Mon, Dec 17, 2012 at 7:57 PM, Mark Miller <ma...@gmail.com> wrote:
> These are the MB/s values I have - I didn't think they would kick in during our tests?
>
>     <double name="maxWriteMBPerSecDefault">1000000</double>
>     <double name="maxWriteMBPerSecFlush">2000000</double>
>     <double name="maxWriteMBPerSecMerge">3000000</double>
>     <double name="maxWriteMBPerSecRead">4000000</double>
>
> Mark
>
> On Dec 17, 2012, at 7:35 PM, Mark Miller <ma...@gmail.com> wrote:
>
>>
>> On Dec 17, 2012, at 7:31 PM, Mark Miller <ma...@gmail.com> wrote:
>>
>>> Socket read timeouts. I'll raise it for this case.
>>
>> Nevermind - it's already at 60 seconds. What's odd is that the commit is taking that long.
>>
>> One of the threads is waiting in the rate limiter - which is weird - I thought I put it absurdly high for tests. I'll dig into it when I get a chance:
>>
>> [junit4:junit4]   1> Thread[qtp29204452-1358,5,TGRP-ShardRoutingTest]
>> [junit4:junit4]   1> java.lang.Thread.sleep(Native Method)
>> [junit4:junit4]   1> java.lang.Thread.sleep(Thread.java:338)
>> [junit4:junit4]   1> org.apache.lucene.store.RateLimiter$SimpleRateLimiter.pause(RateLimiter.java:111)
>> [junit4:junit4]   1> org.apache.lucene.store.RateLimitedIndexOutput.flushBuffer(RateLimitedIndexOutput.java:45)
>> [junit4:junit4]   1> org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:90)
>> [junit4:junit4]   1> org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:79)
>> [junit4:junit4]   1> org.apache.lucene.store.RateLimitedIndexOutput.flush(RateLimitedIndexOutput.java:69)
>> [junit4:junit4]   1> org.apache.lucene.store.BufferedIndexOutput.close(BufferedIndexOutput.java:103)
>> [junit4:junit4]   1> org.apache.lucene.store.RateLimitedIndexOutput.close(RateLimitedIndexOutput.java:78)
>> [junit4:junit4]   1> org.apache.lucene.store.ChecksumIndexOutput.close(ChecksumIndexOutput.java:61)
>> [junit4:junit4]   1> org.apache.lucene.index.SegmentInfos.finishCommit(SegmentInfos.java:927)
>> [junit4:junit4]   1> org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:2826)
>> [junit4:junit4]   1> org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2815)
>> [junit4:junit4]   1> org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2788)
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: [JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_09) - Build # 2203 - Failure!

Posted by Mark Miller <ma...@gmail.com>.
These are the MB/s values I have - I didn't think they would kick in during our tests?

    <double name="maxWriteMBPerSecDefault">1000000</double>
    <double name="maxWriteMBPerSecFlush">2000000</double>
    <double name="maxWriteMBPerSecMerge">3000000</double>
    <double name="maxWriteMBPerSecRead">4000000</double>

Mark

On Dec 17, 2012, at 7:35 PM, Mark Miller <ma...@gmail.com> wrote:

> 
> On Dec 17, 2012, at 7:31 PM, Mark Miller <ma...@gmail.com> wrote:
> 
>> Socket read timeouts. I'll raise it for this case.
> 
> Nevermind - it's already at 60 seconds. What's odd is that the commit is taking that long.
> 
> One of the threads is waiting in the rate limiter - which is weird - I thought I put it absurdly high for tests. I'll dig into it when I get a chance:
> 
> [junit4:junit4]   1> Thread[qtp29204452-1358,5,TGRP-ShardRoutingTest]
> [junit4:junit4]   1> java.lang.Thread.sleep(Native Method)
> [junit4:junit4]   1> java.lang.Thread.sleep(Thread.java:338)
> [junit4:junit4]   1> org.apache.lucene.store.RateLimiter$SimpleRateLimiter.pause(RateLimiter.java:111)
> [junit4:junit4]   1> org.apache.lucene.store.RateLimitedIndexOutput.flushBuffer(RateLimitedIndexOutput.java:45)
> [junit4:junit4]   1> org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:90)
> [junit4:junit4]   1> org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:79)
> [junit4:junit4]   1> org.apache.lucene.store.RateLimitedIndexOutput.flush(RateLimitedIndexOutput.java:69)
> [junit4:junit4]   1> org.apache.lucene.store.BufferedIndexOutput.close(BufferedIndexOutput.java:103)
> [junit4:junit4]   1> org.apache.lucene.store.RateLimitedIndexOutput.close(RateLimitedIndexOutput.java:78)
> [junit4:junit4]   1> org.apache.lucene.store.ChecksumIndexOutput.close(ChecksumIndexOutput.java:61)
> [junit4:junit4]   1> org.apache.lucene.index.SegmentInfos.finishCommit(SegmentInfos.java:927)
> [junit4:junit4]   1> org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:2826)
> [junit4:junit4]   1> org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2815)
> [junit4:junit4]   1> org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2788)


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: [JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_09) - Build # 2203 - Failure!

Posted by Mark Miller <ma...@gmail.com>.
On Dec 17, 2012, at 7:31 PM, Mark Miller <ma...@gmail.com> wrote:

> Socket read timeouts. I'll raise it for this case.

Nevermind - it's already at 60 seconds. What's odd is that the commit is taking that long.

One of the threads is waiting in the rate limiter - which is weird - I thought I put it absurdly high for tests. I'll dig into it when I get a chance:

[junit4:junit4]   1> Thread[qtp29204452-1358,5,TGRP-ShardRoutingTest]
[junit4:junit4]   1> java.lang.Thread.sleep(Native Method)
[junit4:junit4]   1> java.lang.Thread.sleep(Thread.java:338)
[junit4:junit4]   1> org.apache.lucene.store.RateLimiter$SimpleRateLimiter.pause(RateLimiter.java:111)
[junit4:junit4]   1> org.apache.lucene.store.RateLimitedIndexOutput.flushBuffer(RateLimitedIndexOutput.java:45)
[junit4:junit4]   1> org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:90)
[junit4:junit4]   1> org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:79)
[junit4:junit4]   1> org.apache.lucene.store.RateLimitedIndexOutput.flush(RateLimitedIndexOutput.java:69)
[junit4:junit4]   1> org.apache.lucene.store.BufferedIndexOutput.close(BufferedIndexOutput.java:103)
[junit4:junit4]   1> org.apache.lucene.store.RateLimitedIndexOutput.close(RateLimitedIndexOutput.java:78)
[junit4:junit4]   1> org.apache.lucene.store.ChecksumIndexOutput.close(ChecksumIndexOutput.java:61)
[junit4:junit4]   1> org.apache.lucene.index.SegmentInfos.finishCommit(SegmentInfos.java:927)
[junit4:junit4]   1> org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:2826)
[junit4:junit4]   1> org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2815)
[junit4:junit4]   1> org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2788)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: [JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_09) - Build # 2203 - Failure!

Posted by Mark Miller <ma...@gmail.com>.
Socket read timeouts. I'll raise it for this case.

- Mark

On Dec 17, 2012, at 7:02 PM, Policeman Jenkins Server <je...@sd-datasolutions.de> wrote:

> Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Windows/2203/
> Java: 32bit/jdk1.7.0_09 -server -XX:+UseConcMarkSweepGC
> 
> 4 tests failed.
> REGRESSION:  org.apache.solr.cloud.ShardRoutingTest.testDistribSearch
> 
> Error Message:
> There are still nodes recoverying - waited for 180 seconds
> 
> Stack Trace:
> java.lang.AssertionError: There are still nodes recoverying - waited for 180 seconds
> 	at __randomizedtesting.SeedInfo.seed([C86105B07D04D6DF:49878BA80A5BB6E3]:0)
> 	at org.junit.Assert.fail(Assert.java:93)
> 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:175)
> 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:125)
> 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:120)
> 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:557)
> 	at org.apache.solr.cloud.ShardRoutingTest.doTest(ShardRoutingTest.java:116)
> 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:794)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:601)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> 	at java.lang.Thread.run(Thread.java:722)
> 
> 
> FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ShardRoutingTest
> 
> Error Message:
> ERROR: SolrIndexSearcher opens=15 closes=14
> 
> Stack Trace:
> java.lang.AssertionError: ERROR: SolrIndexSearcher opens=15 closes=14
> 	at __randomizedtesting.SeedInfo.seed([C86105B07D04D6DF]:0)
> 	at org.junit.Assert.fail(Assert.java:93)
> 	at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:243)
> 	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:97)
> 	at sun.reflect.GeneratedMethodAccessor19.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:601)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> 	at java.lang.Thread.run(Thread.java:722)
> 
> 
> FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ShardRoutingTest
> 
> Error Message:
> 4 threads leaked from SUITE scope at org.apache.solr.cloud.ShardRoutingTest:     1) Thread[id=1360, name=qtp29204452-1360, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:867)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1197)         at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:214)         at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:290)         at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:490)         at org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:95)         at org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:64)         at org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit(DistributedUpdateProcessor.java:1041)         at org.apache.solr.update.processor.LogUpdateProcessor.processCommit(LogUpdateProcessorFactory.java:157)         at org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandlerUtils.java:69)         at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)         at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:146)         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1819)         at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:458)         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:279)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)         at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:116)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)         at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)         at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)         at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)         at org.eclipse.jetty.server.Server.handle(Server.java:365)         at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)         at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)         at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)         at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:722)    2) Thread[id=1357, name=qtp29204452-1357, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:867)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1197)         at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:214)         at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:290)         at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:490)         at org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:95)         at org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:64)         at org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit(DistributedUpdateProcessor.java:1041)         at org.apache.solr.update.processor.LogUpdateProcessor.processCommit(LogUpdateProcessorFactory.java:157)         at org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandlerUtils.java:69)         at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)         at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:146)         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1819)         at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:458)         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:279)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)         at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:116)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)         at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)         at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)         at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)         at org.eclipse.jetty.server.Server.handle(Server.java:365)         at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)         at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)         at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)         at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:722)    3) Thread[id=1358, name=qtp29204452-1358, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at java.lang.Thread.sleep(Thread.java:338)         at org.apache.lucene.store.RateLimiter$SimpleRateLimiter.pause(RateLimiter.java:111)         at org.apache.lucene.store.RateLimitedIndexOutput.flushBuffer(RateLimitedIndexOutput.java:45)         at org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:90)         at org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:79)         at org.apache.lucene.store.RateLimitedIndexOutput.flush(RateLimitedIndexOutput.java:69)         at org.apache.lucene.store.BufferedIndexOutput.close(BufferedIndexOutput.java:103)         at org.apache.lucene.store.RateLimitedIndexOutput.close(RateLimitedIndexOutput.java:78)         at org.apache.lucene.store.ChecksumIndexOutput.close(ChecksumIndexOutput.java:61)         at org.apache.lucene.util.IOUtils.closeWhileHandlingException(IOUtils.java:203)         at org.apache.lucene.index.SegmentInfos.rollbackCommit(SegmentInfos.java:853)         at org.apache.lucene.index.SegmentInfos.finishCommit(SegmentInfos.java:932)         at org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:2826)         at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2815)         at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2788)         at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:529)         at org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:95)         at org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:64)         at org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit(DistributedUpdateProcessor.java:1041)         at org.apache.solr.update.processor.LogUpdateProcessor.processCommit(LogUpdateProcessorFactory.java:157)         at org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandlerUtils.java:69)         at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)         at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:146)         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1819)         at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:458)         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:279)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)         at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:116)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)         at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)         at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)         at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)         at org.eclipse.jetty.server.Server.handle(Server.java:365)         at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)         at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)         at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)         at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:722)    4) Thread[id=1368, name=searcherExecutor-757-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)         at java.lang.Thread.run(Thread.java:722)
> 
> Stack Trace:
> com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE scope at org.apache.solr.cloud.ShardRoutingTest: 
>   1) Thread[id=1360, name=qtp29204452-1360, state=WAITING, group=TGRP-ShardRoutingTest]
>        at sun.misc.Unsafe.park(Native Method)
>        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
>        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:867)
>        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1197)
>        at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:214)
>        at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:290)
>        at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:490)
>        at org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:95)
>        at org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:64)
>        at org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit(DistributedUpdateProcessor.java:1041)
>        at org.apache.solr.update.processor.LogUpdateProcessor.processCommit(LogUpdateProcessorFactory.java:157)
>        at org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandlerUtils.java:69)
>        at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
>        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:146)
>        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1819)
>        at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:458)
>        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:279)
>        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
>        at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:116)
>        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
>        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
>        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
>        at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
>        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
>        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
>        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
>        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
>        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
>        at org.eclipse.jetty.server.Server.handle(Server.java:365)
>        at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
>        at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
>        at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
>        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)
>        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
>        at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
>        at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
>        at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>        at java.lang.Thread.run(Thread.java:722)
>   2) Thread[id=1357, name=qtp29204452-1357, state=WAITING, group=TGRP-ShardRoutingTest]
>        at sun.misc.Unsafe.park(Native Method)
>        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
>        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:867)
>        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1197)
>        at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:214)
>        at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:290)
>        at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:490)
>        at org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:95)
>        at org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:64)
>        at org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit(DistributedUpdateProcessor.java:1041)
>        at org.apache.solr.update.processor.LogUpdateProcessor.processCommit(LogUpdateProcessorFactory.java:157)
>        at org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandlerUtils.java:69)
>        at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
>        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:146)
>        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1819)
>        at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:458)
>        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:279)
>        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
>        at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:116)
>        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
>        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
>        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
>        at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
>        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
>        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
>        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
>        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
>        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
>        at org.eclipse.jetty.server.Server.handle(Server.java:365)
>        at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
>        at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
>        at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
>        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)
>        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
>        at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
>        at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
>        at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>        at java.lang.Thread.run(Thread.java:722)
>   3) Thread[id=1358, name=qtp29204452-1358, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]
>        at java.lang.Thread.sleep(Native Method)
>        at java.lang.Thread.sleep(Thread.java:338)
>        at org.apache.lucene.store.RateLimiter$SimpleRateLimiter.pause(RateLimiter.java:111)
>        at org.apache.lucene.store.RateLimitedIndexOutput.flushBuffer(RateLimitedIndexOutput.java:45)
>        at org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:90)
>        at org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:79)
>        at org.apache.lucene.store.RateLimitedIndexOutput.flush(RateLimitedIndexOutput.java:69)
>        at org.apache.lucene.store.BufferedIndexOutput.close(BufferedIndexOutput.java:103)
>        at org.apache.lucene.store.RateLimitedIndexOutput.close(RateLimitedIndexOutput.java:78)
>        at org.apache.lucene.store.ChecksumIndexOutput.close(ChecksumIndexOutput.java:61)
>        at org.apache.lucene.util.IOUtils.closeWhileHandlingException(IOUtils.java:203)
>        at org.apache.lucene.index.SegmentInfos.rollbackCommit(SegmentInfos.java:853)
>        at org.apache.lucene.index.SegmentInfos.finishCommit(SegmentInfos.java:932)
>        at org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:2826)
>        at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2815)
>        at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2788)
>        at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:529)
>        at org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:95)
>        at org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:64)
>        at org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit(DistributedUpdateProcessor.java:1041)
>        at org.apache.solr.update.processor.LogUpdateProcessor.processCommit(LogUpdateProcessorFactory.java:157)
>        at org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandlerUtils.java:69)
>        at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
>        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:146)
>        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1819)
>        at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:458)
>        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:279)
>        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
>        at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:116)
>        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
>        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
>        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
>        at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
>        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
>        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
>        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
>        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
>        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
>        at org.eclipse.jetty.server.Server.handle(Server.java:365)
>        at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
>        at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
>        at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
>        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)
>        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
>        at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
>        at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
>        at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>        at java.lang.Thread.run(Thread.java:722)
>   4) Thread[id=1368, name=searcherExecutor-757-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]
>        at sun.misc.Unsafe.park(Native Method)
>        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>        at java.lang.Thread.run(Thread.java:722)
> 	at __randomizedtesting.SeedInfo.seed([C86105B07D04D6DF]:0)
> 
> 
> FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ShardRoutingTest
> 
> Error Message:
> There are still zombie threads that couldn't be terminated:    1) Thread[id=1357, name=qtp29204452-1357, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at java.lang.Thread.sleep(Thread.java:338)         at org.apache.lucene.store.RateLimiter$SimpleRateLimiter.pause(RateLimiter.java:111)         at org.apache.lucene.store.RateLimitedIndexOutput.flushBuffer(RateLimitedIndexOutput.java:45)         at org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:90)         at org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:79)         at org.apache.lucene.store.RateLimitedIndexOutput.flush(RateLimitedIndexOutput.java:69)         at org.apache.lucene.store.BufferedIndexOutput.close(BufferedIndexOutput.java:103)         at org.apache.lucene.store.RateLimitedIndexOutput.close(RateLimitedIndexOutput.java:78)         at org.apache.lucene.store.ChecksumIndexOutput.close(ChecksumIndexOutput.java:61)         at org.apache.lucene.util.IOUtils.closeWhileHandlingException(IOUtils.java:203)         at org.apache.lucene.index.SegmentInfos.rollbackCommit(SegmentInfos.java:853)         at org.apache.lucene.index.SegmentInfos.finishCommit(SegmentInfos.java:932)         at org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:2826)         at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2815)         at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:966)         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:830)         at org.apache.solr.update.SolrIndexWriter.close(SolrIndexWriter.java:145)         at org.apache.solr.update.DirectUpdateHandler2.closeWriter(DirectUpdateHandler2.java:730)         at org.apache.solr.update.DefaultSolrCoreState.closeIndexWriter(DefaultSolrCoreState.java:64)         at org.apache.solr.update.DefaultSolrCoreState.close(DefaultSolrCoreState.java:272)         at org.apache.solr.core.SolrCore.decrefSolrCoreState(SolrCore.java:883)         at org.apache.solr.core.SolrCore.close(SolrCore.java:975)         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:308)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)         at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:116)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)         at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)         at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)         at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)         at org.eclipse.jetty.server.Server.handle(Server.java:365)         at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)         at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)         at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)         at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:722)    2) Thread[id=1368, name=searcherExecutor-757-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)         at java.lang.Thread.run(Thread.java:722)
> 
> Stack Trace:
> com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
>   1) Thread[id=1357, name=qtp29204452-1357, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]
>        at java.lang.Thread.sleep(Native Method)
>        at java.lang.Thread.sleep(Thread.java:338)
>        at org.apache.lucene.store.RateLimiter$SimpleRateLimiter.pause(RateLimiter.java:111)
>        at org.apache.lucene.store.RateLimitedIndexOutput.flushBuffer(RateLimitedIndexOutput.java:45)
>        at org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:90)
>        at org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:79)
>        at org.apache.lucene.store.RateLimitedIndexOutput.flush(RateLimitedIndexOutput.java:69)
>        at org.apache.lucene.store.BufferedIndexOutput.close(BufferedIndexOutput.java:103)
>        at org.apache.lucene.store.RateLimitedIndexOutput.close(RateLimitedIndexOutput.java:78)
>        at org.apache.lucene.store.ChecksumIndexOutput.close(ChecksumIndexOutput.java:61)
>        at org.apache.lucene.util.IOUtils.closeWhileHandlingException(IOUtils.java:203)
>        at org.apache.lucene.index.SegmentInfos.rollbackCommit(SegmentInfos.java:853)
>        at org.apache.lucene.index.SegmentInfos.finishCommit(SegmentInfos.java:932)
>        at org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:2826)
>        at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2815)
>        at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:966)
>        at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
>        at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:830)
>        at org.apache.solr.update.SolrIndexWriter.close(SolrIndexWriter.java:145)
>        at org.apache.solr.update.DirectUpdateHandler2.closeWriter(DirectUpdateHandler2.java:730)
>        at org.apache.solr.update.DefaultSolrCoreState.closeIndexWriter(DefaultSolrCoreState.java:64)
>        at org.apache.solr.update.DefaultSolrCoreState.close(DefaultSolrCoreState.java:272)
>        at org.apache.solr.core.SolrCore.decrefSolrCoreState(SolrCore.java:883)
>        at org.apache.solr.core.SolrCore.close(SolrCore.java:975)
>        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:308)
>        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
>        at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:116)
>        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
>        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
>        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
>        at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
>        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
>        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
>        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
>        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
>        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
>        at org.eclipse.jetty.server.Server.handle(Server.java:365)
>        at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
>        at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
>        at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
>        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)
>        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
>        at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
>        at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
>        at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>        at java.lang.Thread.run(Thread.java:722)
>   2) Thread[id=1368, name=searcherExecutor-757-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]
>        at sun.misc.Unsafe.park(Native Method)
>        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>        at java.lang.Thread.run(Thread.java:722)
> 	at __randomizedtesting.SeedInfo.seed([C86105B07D04D6DF]:0)
> 
> 
> 
> 
> Build Log:
> [...truncated 8789 lines...]
> [junit4:junit4] Suite: org.apache.solr.cloud.ShardRoutingTest
> [junit4:junit4]   2> 0 T1325 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
> [junit4:junit4]   2> 4 T1325 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
> [junit4:junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-ShardRoutingTest-1355788516961
> [junit4:junit4]   2> 6 T1325 oasc.ZkTestServer.run STARTING ZK TEST SERVER
> [junit4:junit4]   2> 7 T1326 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
> [junit4:junit4]   2> 10 T1326 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
> [junit4:junit4]   2> 10 T1326 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
> [junit4:junit4]   2> 10 T1326 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
> [junit4:junit4]   2> 11 T1326 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
> [junit4:junit4]   2> 12 T1326 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\zookeeper\server1\data\version-2\snapshot.0
> [junit4:junit4]   2> 108 T1325 oasc.ZkTestServer.run start zk server on port:63821
> [junit4:junit4]   2> 109 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@9b07ed
> [junit4:junit4]   2> 111 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 113 T1331 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 114 T1331 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
> [junit4:junit4]   2> 114 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63824
> [junit4:junit4]   2> 115 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63824
> [junit4:junit4]   2> 116 T1329 oazsp.FileTxnLog.append Creating new log file: log.1
> [junit4:junit4]   2> 149 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a0000 with negotiated timeout 10000 for client /127.0.0.1:63824
> [junit4:junit4]   2> 149 T1331 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a0000, negotiated timeout = 10000
> [junit4:junit4]   2> 150 T1332 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9b07ed name:ZooKeeperConnection Watcher:127.0.0.1:63821 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 151 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 152 T1325 oascc.SolrZkClient.makePath makePath: /solr
> [junit4:junit4]   2> 162 T1330 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bab4afe6a0000
> [junit4:junit4]   2> 166 T1327 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:63824 which had sessionid 0x13bab4afe6a0000
> [junit4:junit4]   2> 166 T1332 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 166 T1325 oaz.ZooKeeper.close Session: 0x13bab4afe6a0000 closed
> [junit4:junit4]   2> 167 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@f68ca5
> [junit4:junit4]   2> 170 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 171 T1333 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 172 T1333 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
> [junit4:junit4]   2> 172 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63827
> [junit4:junit4]   2> 173 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63827
> [junit4:junit4]   2> 176 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a0001 with negotiated timeout 10000 for client /127.0.0.1:63827
> [junit4:junit4]   2> 176 T1333 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a0001, negotiated timeout = 10000
> [junit4:junit4]   2> 177 T1334 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f68ca5 name:ZooKeeperConnection Watcher:127.0.0.1:63821/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 178 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 178 T1325 oascc.SolrZkClient.makePath makePath: /collections/collection1
> [junit4:junit4]   2> 192 T1325 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
> [junit4:junit4]   2> 201 T1325 oascc.SolrZkClient.makePath makePath: /collections/control_collection
> [junit4:junit4]   2> 210 T1325 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
> [junit4:junit4]   2> 223 T1325 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.xml to /configs/conf1/solrconfig.xml
> [junit4:junit4]   2> 225 T1325 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
> [junit4:junit4]   2> 248 T1325 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
> [junit4:junit4]   2> 249 T1325 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
> [junit4:junit4]   2> 254 T1325 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
> [junit4:junit4]   2> 254 T1325 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
> [junit4:junit4]   2> 259 T1325 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
> [junit4:junit4]   2> 259 T1325 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
> [junit4:junit4]   2> 265 T1325 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
> [junit4:junit4]   2> 265 T1325 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
> [junit4:junit4]   2> 270 T1325 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
> [junit4:junit4]   2> 271 T1325 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
> [junit4:junit4]   2> 276 T1325 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
> [junit4:junit4]   2> 276 T1325 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
> [junit4:junit4]   2> 282 T1325 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
> [junit4:junit4]   2> 282 T1325 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
> [junit4:junit4]   2> 287 T1325 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
> [junit4:junit4]   2> 288 T1325 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
> [junit4:junit4]   2> 294 T1330 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bab4afe6a0001
> [junit4:junit4]   2> 295 T1327 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:63827 which had sessionid 0x13bab4afe6a0001
> [junit4:junit4]   2> 296 T1334 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 296 T1325 oaz.ZooKeeper.close Session: 0x13bab4afe6a0001 closed
> [junit4:junit4]   2> 633 T1325 oejs.Server.doStart jetty-8.1.8.v20121106
> [junit4:junit4]   2> 640 T1325 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63828
> [junit4:junit4]   2> 641 T1325 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 641 T1325 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252
> [junit4:junit4]   2> 642 T1325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252\'
> [junit4:junit4]   2> 678 T1325 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4]   2> 678 T1325 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 678 T1325 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252
> [junit4:junit4]   2> 679 T1325 oasc.CoreContainer$Initializer.initialize looking for solr.xml: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252\solr.xml
> [junit4:junit4]   2> 679 T1325 oasc.CoreContainer.<init> New CoreContainer 17350458
> [junit4:junit4]   2> 680 T1325 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252\'
> [junit4:junit4]   2> 680 T1325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252\'
> [junit4:junit4]   2> 706 T1325 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
> [junit4:junit4]   2> 706 T1325 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4]   2> 707 T1325 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4]   2> 707 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4]   2> 707 T1325 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4]   2> 708 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4]   2> 708 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4]   2> 708 T1325 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4]   2> 709 T1325 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4]   2> 709 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
> [junit4:junit4]   2> 724 T1325 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4]   2> 744 T1325 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:63821/solr
> [junit4:junit4]   2> 744 T1325 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4]   2> 745 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@14458a1
> [junit4:junit4]   2> 746 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 747 T1344 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 748 T1344 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
> [junit4:junit4]   2> 749 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63833
> [junit4:junit4]   2> 749 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63833
> [junit4:junit4]   2> 758 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a0002 with negotiated timeout 20000 for client /127.0.0.1:63833
> [junit4:junit4]   2> 758 T1344 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a0002, negotiated timeout = 20000
> [junit4:junit4]   2> 759 T1345 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14458a1 name:ZooKeeperConnection Watcher:127.0.0.1:63821 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 759 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 761 T1330 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bab4afe6a0002
> [junit4:junit4]   2> 763 T1345 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 763 T1327 oazs.NIOServerCnxn.doIO WARNING caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13bab4afe6a0002, likely client has closed socket
> [junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
> [junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
> [junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
> [junit4:junit4]   2> 
> [junit4:junit4]   2> 763 T1325 oaz.ZooKeeper.close Session: 0x13bab4afe6a0002 closed
> [junit4:junit4]   2> 765 T1327 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:63833 which had sessionid 0x13bab4afe6a0002
> [junit4:junit4]   2> 765 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
> [junit4:junit4]   2> 774 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@ae1edd
> [junit4:junit4]   2> 776 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 779 T1346 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 780 T1346 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
> [junit4:junit4]   2> 780 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63836
> [junit4:junit4]   2> 780 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63836
> [junit4:junit4]   2> 783 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a0003 with negotiated timeout 20000 for client /127.0.0.1:63836
> [junit4:junit4]   2> 783 T1346 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a0003, negotiated timeout = 20000
> [junit4:junit4]   2> 784 T1347 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ae1edd name:ZooKeeperConnection Watcher:127.0.0.1:63821/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 785 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 788 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 791 T1325 oascc.SolrZkClient.makePath makePath: /live_nodes
> [junit4:junit4]   2> 794 T1325 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63828_
> [junit4:junit4]   2> 795 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:63828_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:63828_
> [junit4:junit4]   2> 795 T1325 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63828_
> [junit4:junit4]   2> 800 T1325 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
> [junit4:junit4]   2> 809 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
> [junit4:junit4]   2> 811 T1325 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
> [junit4:junit4]   2> 815 T1325 oasc.Overseer.start Overseer (id=88852956248145923-127.0.0.1:63828_-n_0000000000) starting
> [junit4:junit4]   2> 816 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 818 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 820 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 822 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 824 T1349 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
> [junit4:junit4]   2> 825 T1325 oascc.SolrZkClient.makePath makePath: /clusterstate.json
> [junit4:junit4]   2> 832 T1325 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4:junit4]   2> 837 T1348 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
> [junit4:junit4]   2> 844 T1350 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252\collection1
> [junit4:junit4]   2> 844 T1350 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
> [junit4:junit4]   2> 846 T1350 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4]   2> 847 T1350 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
> [junit4:junit4]   2> 850 T1350 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252\collection1\'
> [junit4:junit4]   2> 852 T1350 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252/collection1/lib/classes/' to classloader
> [junit4:junit4]   2> 854 T1350 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252/collection1/lib/README' to classloader
> [junit4:junit4]   2> 922 T1350 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
> [junit4:junit4]   2> 994 T1350 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4]   2> 996 T1350 oass.IndexSchema.readSchema Reading Solr Schema
> [junit4:junit4]   2> 1000 T1350 oass.IndexSchema.readSchema Schema name=test
> [junit4:junit4]   2> 1601 T1350 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4]   2> 1605 T1350 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4]   2> 1637 T1350 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-controljetty-1355788517252\collection1\, dataDir=.\org.apache.solr.cloud.ShardRoutingTest-1355788516960/control/data\
> [junit4:junit4]   2> 1637 T1350 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d35dc5
> [junit4:junit4]   2> 1638 T1350 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
> [junit4:junit4]   2> 1639 T1350 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\control\data forceNew:false
> [junit4:junit4]   2> 1640 T1350 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\control\data
> [junit4:junit4]   2> 1640 T1350 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ShardRoutingTest-1355788516960/control/data\index/
> [junit4:junit4]   2> 1641 T1350 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\control\data\index' doesn't exist. Creating new index...
> [junit4:junit4]   2> 1641 T1350 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\control\data\index forceNew:false
> [junit4:junit4]   2> 1654 T1350 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ShardRoutingTest-1355788516960\control\data\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1539688; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 1654 T1350 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
> [junit4:junit4]   2> 1656 T1350 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\control\data\index
> [junit4:junit4]   2> 1656 T1350 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
> [junit4:junit4]   2> 1657 T1350 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4]   2> 1658 T1350 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4]   2> 1658 T1350 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4]   2> 1658 T1350 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
> [junit4:junit4]   2> 1659 T1350 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4]   2> 1659 T1350 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4]   2> 1659 T1350 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4]   2> 1660 T1350 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4]   2> 1661 T1350 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4]   2> 1661 T1350 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
> [junit4:junit4]   2> 1662 T1350 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4]   2> 1662 T1350 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   2> 1663 T1350 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
> [junit4:junit4]   2> 1663 T1350 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4]   2> 1663 T1350 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
> [junit4:junit4]   2> 1664 T1350 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4]   2> 1665 T1350 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1665 T1350 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1666 T1350 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1666 T1350 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1667 T1350 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1668 T1350 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1668 T1350 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1669 T1350 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1670 T1350 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4]   2> 1670 T1350 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4]   2> 1680 T1350 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4]   2> 1685 T1350 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
> [junit4:junit4]   2> 1687 T1350 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
> [junit4:junit4]   2> 1690 T1350 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\control\data
> [junit4:junit4]   2> 1691 T1350 oass.SolrIndexSearcher.<init> Opening Searcher@53f819 main
> [junit4:junit4]   2> 1693 T1350 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4]   2> 1693 T1350 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4]   2> 1694 T1350 oashc.SpellCheckComponent.inform Initializing spell checkers
> [junit4:junit4]   2> 1704 T1350 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
> [junit4:junit4]   2> 1769 T1351 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@53f819 main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   2> 1772 T1350 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4]   2> 1772 T1350 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 1773 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:create cxid:0x5f zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
> [junit4:junit4]   2> 1847 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 1849 T1348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":"1",
> [junit4:junit4]   2> 	  "shard":null,
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"control_collection",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:63828_",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:63828"}
> [junit4:junit4]   2> 1849 T1348 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
> [junit4:junit4]   2> 1850 T1348 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
> [junit4:junit4]   2> 1851 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:create cxid:0x67 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
> [junit4:junit4]   2> 1875 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   2> 2279 T1350 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4]   2> 2279 T1350 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:63828 shardId:shard1
> [junit4:junit4]   2> 2281 T1350 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
> [junit4:junit4]   2> 2306 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:delete cxid:0x81 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
> [junit4:junit4]   2> 2310 T1350 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
> [junit4:junit4]   2> 2311 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:create cxid:0x82 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 2319 T1350 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4:junit4]   2> 2320 T1350 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4:junit4]   2> 2321 T1350 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:63828/collection1/
> [junit4:junit4]   2> 2321 T1350 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4:junit4]   2> 2322 T1350 oasc.SyncStrategy.syncToMe http://127.0.0.1:63828/collection1/ has no replicas
> [junit4:junit4]   2> 2322 T1350 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:63828/collection1/
> [junit4:junit4]   2> 2322 T1350 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
> [junit4:junit4]   2> 2337 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0003 type:create cxid:0x8c zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 2387 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 2419 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   2> 2448 T1350 oasc.ZkController.register We are http://127.0.0.1:63828/collection1/ and leader is http://127.0.0.1:63828/collection1/
> [junit4:junit4]   2> 2448 T1350 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:63828
> [junit4:junit4]   2> 2448 T1350 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4:junit4]   2> 2449 T1350 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4]   2> 2449 T1350 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 2455 T1350 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 2458 T1325 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
> [junit4:junit4]   2> 2459 T1325 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4]   2> 2459 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 2478 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:
> [junit4:junit4]   2> 2482 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@ce3abc
> [junit4:junit4]   2> 2484 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 2485 T1352 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 2485 T1352 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
> [junit4:junit4]   2> 2486 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63839
> [junit4:junit4]   2> 2486 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63839
> [junit4:junit4]   2> 2488 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a0004 with negotiated timeout 10000 for client /127.0.0.1:63839
> [junit4:junit4]   2> 2488 T1352 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a0004, negotiated timeout = 10000
> [junit4:junit4]   2> 2489 T1353 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ce3abc name:ZooKeeperConnection Watcher:127.0.0.1:63821/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 2489 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 2490 T1325 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4:junit4]   2> 2493 T1325 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
> [junit4:junit4]   2> 2814 T1325 oejs.Server.doStart jetty-8.1.8.v20121106
> [junit4:junit4]   2> 2818 T1325 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63840
> [junit4:junit4]   2> 2819 T1325 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 2820 T1325 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449
> [junit4:junit4]   2> 2820 T1325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449\'
> [junit4:junit4]   2> 2859 T1325 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4]   2> 2860 T1325 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 2860 T1325 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449
> [junit4:junit4]   2> 2860 T1325 oasc.CoreContainer$Initializer.initialize looking for solr.xml: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449\solr.xml
> [junit4:junit4]   2> 2861 T1325 oasc.CoreContainer.<init> New CoreContainer 31985776
> [junit4:junit4]   2> 2861 T1325 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449\'
> [junit4:junit4]   2> 2862 T1325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449\'
> [junit4:junit4]   2> 2886 T1325 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
> [junit4:junit4]   2> 2887 T1325 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4]   2> 2887 T1325 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4]   2> 2888 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4]   2> 2888 T1325 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4]   2> 2888 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4]   2> 2889 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4]   2> 2889 T1325 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4]   2> 2889 T1325 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4]   2> 2890 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
> [junit4:junit4]   2> 2903 T1325 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4]   2> 2924 T1325 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:63821/solr
> [junit4:junit4]   2> 2925 T1325 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4]   2> 2925 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@12fffa6
> [junit4:junit4]   2> 2927 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 2927 T1363 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 2928 T1363 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
> [junit4:junit4]   2> 2928 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63845
> [junit4:junit4]   2> 2928 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63845
> [junit4:junit4]   2> 2941 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a0005 with negotiated timeout 20000 for client /127.0.0.1:63845
> [junit4:junit4]   2> 2941 T1363 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a0005, negotiated timeout = 20000
> [junit4:junit4]   2> 2942 T1364 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12fffa6 name:ZooKeeperConnection Watcher:127.0.0.1:63821 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 2942 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 2945 T1330 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bab4afe6a0005
> [junit4:junit4]   2> 2947 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 2947 T1327 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:63845 which had sessionid 0x13bab4afe6a0005
> [junit4:junit4]   2> 2948 T1364 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 2948 T1325 oaz.ZooKeeper.close Session: 0x13bab4afe6a0005 closed
> [junit4:junit4]   2> 2949 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
> [junit4:junit4]   2> 2950 T1348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":"1",
> [junit4:junit4]   2> 	  "shard":"shard1",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"control_collection",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:63828_",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:63828"}
> [junit4:junit4]   2> 2955 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@17b90b
> [junit4:junit4]   2> 2958 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 2958 T1365 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 2959 T1365 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
> [junit4:junit4]   2> 2959 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   2> 2959 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63848
> [junit4:junit4]   2> 2960 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63848
> [junit4:junit4]   2> 2959 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   2> 2962 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a0006 with negotiated timeout 20000 for client /127.0.0.1:63848
> [junit4:junit4]   2> 2962 T1365 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a0006, negotiated timeout = 20000
> [junit4:junit4]   2> 2962 T1366 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17b90b name:ZooKeeperConnection Watcher:127.0.0.1:63821/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 2963 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 2966 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0006 type:create cxid:0x1 zxid:0x4d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 2969 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0006 type:create cxid:0x2 zxid:0x4e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 2971 T1325 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63840_
> [junit4:junit4]   2> 2972 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0006 type:delete cxid:0x4 zxid:0x4f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:63840_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:63840_
> [junit4:junit4]   2> 2974 T1325 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63840_
> [junit4:junit4]   2> 2978 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   2> 2979 T1353 oascc.ZkStateReader$3.process Updating live nodes... (2)
> [junit4:junit4]   2> 2979 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 2981 T1347 oascc.ZkStateReader$3.process Updating live nodes... (2)
> [junit4:junit4]   2> 2985 T1325 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4:junit4]   2> 2994 T1367 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449\collection1
> [junit4:junit4]   2> 2995 T1367 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4]   2> 2995 T1367 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4]   2> 2996 T1367 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4]   2> 2998 T1367 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449\collection1\'
> [junit4:junit4]   2> 3000 T1367 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449/collection1/lib/classes/' to classloader
> [junit4:junit4]   2> 3001 T1367 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449/collection1/lib/README' to classloader
> [junit4:junit4]   2> 3064 T1367 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
> [junit4:junit4]   2> 3134 T1367 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4]   2> 3136 T1367 oass.IndexSchema.readSchema Reading Solr Schema
> [junit4:junit4]   2> 3141 T1367 oass.IndexSchema.readSchema Schema name=test
> [junit4:junit4]   2> 3775 T1367 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4]   2> 3778 T1367 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4]   2> 3810 T1367 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty1-1355788519449\collection1\, dataDir=.\org.apache.solr.cloud.ShardRoutingTest-1355788516960/jetty1\
> [junit4:junit4]   2> 3811 T1367 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d35dc5
> [junit4:junit4]   2> 3811 T1367 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
> [junit4:junit4]   2> 3812 T1367 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty1 forceNew:false
> [junit4:junit4]   2> 3813 T1367 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty1
> [junit4:junit4]   2> 3813 T1367 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ShardRoutingTest-1355788516960/jetty1\index/
> [junit4:junit4]   2> 3814 T1367 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty1\index' doesn't exist. Creating new index...
> [junit4:junit4]   2> 3815 T1367 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty1\index forceNew:false
> [junit4:junit4]   2> 3828 T1367 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a57753; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 3828 T1367 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
> [junit4:junit4]   2> 3830 T1367 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty1\index
> [junit4:junit4]   2> 3830 T1367 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
> [junit4:junit4]   2> 3833 T1367 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4]   2> 3833 T1367 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4]   2> 3834 T1367 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4]   2> 3834 T1367 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
> [junit4:junit4]   2> 3835 T1367 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4]   2> 3835 T1367 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4]   2> 3835 T1367 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4]   2> 3836 T1367 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4]   2> 3837 T1367 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4]   2> 3837 T1367 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
> [junit4:junit4]   2> 3838 T1367 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4]   2> 3838 T1367 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   2> 3839 T1367 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
> [junit4:junit4]   2> 3839 T1367 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4]   2> 3839 T1367 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
> [junit4:junit4]   2> 3840 T1367 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4]   2> 3840 T1367 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3849 T1367 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3850 T1367 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3850 T1367 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3851 T1367 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3852 T1367 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3852 T1367 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3853 T1367 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3855 T1367 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4]   2> 3855 T1367 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4]   2> 3867 T1367 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4]   2> 3872 T1367 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
> [junit4:junit4]   2> 3874 T1367 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
> [junit4:junit4]   2> 3876 T1367 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty1
> [junit4:junit4]   2> 3878 T1367 oass.SolrIndexSearcher.<init> Opening Searcher@11dad60 main
> [junit4:junit4]   2> 3880 T1367 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4]   2> 3880 T1367 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4]   2> 3880 T1367 oashc.SpellCheckComponent.inform Initializing spell checkers
> [junit4:junit4]   2> 3892 T1367 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
> [junit4:junit4]   2> 3959 T1368 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@11dad60 main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   2> 3962 T1367 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4]   2> 3962 T1367 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 3974 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 3975 T1348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":"4",
> [junit4:junit4]   2> 	  "shard":null,
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:63840_",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:63840"}
> [junit4:junit4]   2> 3975 T1348 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 4
> [junit4:junit4]   2> 3976 T1348 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
> [junit4:junit4]   2> 3987 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 3987 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 3987 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 4466 T1367 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4]   2> 4466 T1367 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:63840 shardId:shard1
> [junit4:junit4]   2> 4468 T1367 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
> [junit4:junit4]   2> 4494 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0006 type:delete cxid:0x4f zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
> [junit4:junit4]   2> 4498 T1367 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
> [junit4:junit4]   2> 4501 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0006 type:create cxid:0x50 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 4509 T1367 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4:junit4]   2> 4509 T1367 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4:junit4]   2> 4510 T1367 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:63840/collection1/
> [junit4:junit4]   2> 4510 T1367 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4:junit4]   2> 4510 T1367 oasc.SyncStrategy.syncToMe http://127.0.0.1:63840/collection1/ has no replicas
> [junit4:junit4]   2> 4511 T1367 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:63840/collection1/
> [junit4:junit4]   2> 4512 T1367 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
> [junit4:junit4]   2> 4527 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0006 type:create cxid:0x5a zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 5010 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 5043 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 5043 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 5043 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 5097 T1367 oasc.ZkController.register We are http://127.0.0.1:63840/collection1/ and leader is http://127.0.0.1:63840/collection1/
> [junit4:junit4]   2> 5097 T1367 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:63840
> [junit4:junit4]   2> 5097 T1367 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4:junit4]   2> 5097 T1367 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4]   2> 5097 T1367 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 5103 T1367 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 5106 T1325 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
> [junit4:junit4]   2> 5107 T1325 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4]   2> 5107 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 5440 T1325 oejs.Server.doStart jetty-8.1.8.v20121106
> [junit4:junit4]   2> 5443 T1325 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63849
> [junit4:junit4]   2> 5444 T1325 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 5445 T1325 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086
> [junit4:junit4]   2> 5445 T1325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086\'
> [junit4:junit4]   2> 5482 T1325 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4]   2> 5482 T1325 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 5482 T1325 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086
> [junit4:junit4]   2> 5484 T1325 oasc.CoreContainer$Initializer.initialize looking for solr.xml: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086\solr.xml
> [junit4:junit4]   2> 5484 T1325 oasc.CoreContainer.<init> New CoreContainer 14806450
> [junit4:junit4]   2> 5485 T1325 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086\'
> [junit4:junit4]   2> 5485 T1325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086\'
> [junit4:junit4]   2> 5508 T1325 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
> [junit4:junit4]   2> 5509 T1325 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4]   2> 5510 T1325 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4]   2> 5510 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4]   2> 5511 T1325 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4]   2> 5511 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4]   2> 5512 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4]   2> 5512 T1325 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4]   2> 5512 T1325 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4]   2> 5513 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
> [junit4:junit4]   2> 5527 T1325 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4]   2> 5545 T1325 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:63821/solr
> [junit4:junit4]   2> 5545 T1325 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4]   2> 5546 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4df7d9
> [junit4:junit4]   2> 5548 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 5549 T1378 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 5549 T1378 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
> [junit4:junit4]   2> 5549 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63854
> [junit4:junit4]   2> 5550 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63854
> [junit4:junit4]   2> 5560 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a0007 with negotiated timeout 20000 for client /127.0.0.1:63854
> [junit4:junit4]   2> 5560 T1378 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a0007, negotiated timeout = 20000
> [junit4:junit4]   2> 5561 T1379 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4df7d9 name:ZooKeeperConnection Watcher:127.0.0.1:63821 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 5561 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 5564 T1330 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bab4afe6a0007
> [junit4:junit4]   2> 5566 T1327 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:63854 which had sessionid 0x13bab4afe6a0007
> [junit4:junit4]   2> 5566 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 5566 T1325 oaz.ZooKeeper.close Session: 0x13bab4afe6a0007 closed
> [junit4:junit4]   2> 5567 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
> [junit4:junit4]   2> 5567 T1379 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 5569 T1348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":"4",
> [junit4:junit4]   2> 	  "shard":"shard1",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:63840_",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:63840"}
> [junit4:junit4]   2> 5572 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ba381e
> [junit4:junit4]   2> 5575 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 5576 T1380 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 5577 T1380 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
> [junit4:junit4]   2> 5577 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63857
> [junit4:junit4]   2> 5578 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63857
> [junit4:junit4]   2> 5579 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 5579 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 5579 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 5581 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a0008 with negotiated timeout 20000 for client /127.0.0.1:63857
> [junit4:junit4]   2> 5581 T1380 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a0008, negotiated timeout = 20000
> [junit4:junit4]   2> 5581 T1381 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ba381e name:ZooKeeperConnection Watcher:127.0.0.1:63821/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 5581 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 5583 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0008 type:create cxid:0x1 zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 5586 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0008 type:create cxid:0x2 zxid:0x71 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 5591 T1325 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63849_
> [junit4:junit4]   2> 5600 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0008 type:delete cxid:0x4 zxid:0x73 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:63849_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:63849_
> [junit4:junit4]   2> 5608 T1325 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63849_
> [junit4:junit4]   2> 5612 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 5613 T1366 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4:junit4]   2> 5614 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 5614 T1353 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4:junit4]   2> 5614 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 5618 T1347 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4:junit4]   2> 5622 T1325 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4:junit4]   2> 5632 T1382 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086\collection1
> [junit4:junit4]   2> 5632 T1382 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4]   2> 5634 T1382 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4]   2> 5634 T1382 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4]   2> 5637 T1382 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086\collection1\'
> [junit4:junit4]   2> 5639 T1382 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086/collection1/lib/classes/' to classloader
> [junit4:junit4]   2> 5641 T1382 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086/collection1/lib/README' to classloader
> [junit4:junit4]   2> 5703 T1382 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
> [junit4:junit4]   2> 5768 T1382 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4]   2> 5769 T1382 oass.IndexSchema.readSchema Reading Solr Schema
> [junit4:junit4]   2> 5774 T1382 oass.IndexSchema.readSchema Schema name=test
> [junit4:junit4]   2> 6337 T1382 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4]   2> 6341 T1382 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4]   2> 6379 T1382 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty2-1355788522086\collection1\, dataDir=.\org.apache.solr.cloud.ShardRoutingTest-1355788516960/jetty2\
> [junit4:junit4]   2> 6380 T1382 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d35dc5
> [junit4:junit4]   2> 6380 T1382 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
> [junit4:junit4]   2> 6382 T1382 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty2 forceNew:false
> [junit4:junit4]   2> 6382 T1382 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty2
> [junit4:junit4]   2> 6382 T1382 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ShardRoutingTest-1355788516960/jetty2\index/
> [junit4:junit4]   2> 6383 T1382 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty2\index' doesn't exist. Creating new index...
> [junit4:junit4]   2> 6383 T1382 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty2\index forceNew:false
> [junit4:junit4]   2> 6393 T1382 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty2\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1aa0129; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 6393 T1382 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
> [junit4:junit4]   2> 6395 T1382 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty2\index
> [junit4:junit4]   2> 6395 T1382 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
> [junit4:junit4]   2> 6398 T1382 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4]   2> 6398 T1382 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4]   2> 6398 T1382 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4]   2> 6398 T1382 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
> [junit4:junit4]   2> 6400 T1382 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4]   2> 6400 T1382 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4]   2> 6401 T1382 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4]   2> 6401 T1382 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4]   2> 6402 T1382 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4]   2> 6403 T1382 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
> [junit4:junit4]   2> 6404 T1382 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4]   2> 6404 T1382 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   2> 6404 T1382 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
> [junit4:junit4]   2> 6404 T1382 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4]   2> 6405 T1382 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
> [junit4:junit4]   2> 6406 T1382 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4]   2> 6407 T1382 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 6407 T1382 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 6408 T1382 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 6409 T1382 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 6410 T1382 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 6410 T1382 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 6411 T1382 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 6412 T1382 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 6413 T1382 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4]   2> 6413 T1382 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4]   2> 6424 T1382 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4]   2> 6429 T1382 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
> [junit4:junit4]   2> 6430 T1382 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
> [junit4:junit4]   2> 6433 T1382 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty2
> [junit4:junit4]   2> 6435 T1382 oass.SolrIndexSearcher.<init> Opening Searcher@e594a2 main
> [junit4:junit4]   2> 6436 T1382 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4]   2> 6437 T1382 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4]   2> 6437 T1382 oashc.SpellCheckComponent.inform Initializing spell checkers
> [junit4:junit4]   2> 6448 T1382 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
> [junit4:junit4]   2> 6504 T1382 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4]   2> 6505 T1382 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 6506 T1383 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e594a2 main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   2> 6619 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 6620 T1348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":"4",
> [junit4:junit4]   2> 	  "shard":null,
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:63849_",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:63849"}
> [junit4:junit4]   2> 6620 T1348 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=4
> [junit4:junit4]   2> 6620 T1348 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
> [junit4:junit4]   2> 6628 T1381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 6628 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 6629 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 6630 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 7008 T1382 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4]   2> 7008 T1382 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:63849 shardId:shard2
> [junit4:junit4]   2> 7009 T1382 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
> [junit4:junit4]   2> 7022 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0008 type:delete cxid:0x4e zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
> [junit4:junit4]   2> 7024 T1382 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
> [junit4:junit4]   2> 7024 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0008 type:create cxid:0x4f zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 7028 T1382 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4:junit4]   2> 7028 T1382 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4:junit4]   2> 7028 T1382 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:63849/collection1/
> [junit4:junit4]   2> 7028 T1382 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4:junit4]   2> 7029 T1382 oasc.SyncStrategy.syncToMe http://127.0.0.1:63849/collection1/ has no replicas
> [junit4:junit4]   2> 7029 T1382 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:63849/collection1/
> [junit4:junit4]   2> 7029 T1382 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
> [junit4:junit4]   2> 7035 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a0008 type:create cxid:0x58 zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 7140 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 7179 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 7179 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 7180 T1381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 7182 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 7191 T1382 oasc.ZkController.register We are http://127.0.0.1:63849/collection1/ and leader is http://127.0.0.1:63849/collection1/
> [junit4:junit4]   2> 7191 T1382 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:63849
> [junit4:junit4]   2> 7191 T1382 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4:junit4]   2> 7191 T1382 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4]   2> 7191 T1382 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 7195 T1382 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 7196 T1325 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
> [junit4:junit4]   2> 7196 T1325 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4]   2> 7197 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 7527 T1325 oejs.Server.doStart jetty-8.1.8.v20121106
> [junit4:junit4]   2> 7532 T1325 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63858
> [junit4:junit4]   2> 7533 T1325 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 7533 T1325 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163
> [junit4:junit4]   2> 7534 T1325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163\'
> [junit4:junit4]   2> 7569 T1325 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4]   2> 7570 T1325 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 7570 T1325 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163
> [junit4:junit4]   2> 7571 T1325 oasc.CoreContainer$Initializer.initialize looking for solr.xml: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163\solr.xml
> [junit4:junit4]   2> 7571 T1325 oasc.CoreContainer.<init> New CoreContainer 6943436
> [junit4:junit4]   2> 7572 T1325 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163\'
> [junit4:junit4]   2> 7572 T1325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163\'
> [junit4:junit4]   2> 7596 T1325 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
> [junit4:junit4]   2> 7597 T1325 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4]   2> 7598 T1325 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4]   2> 7598 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4]   2> 7598 T1325 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4]   2> 7599 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4]   2> 7599 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4]   2> 7599 T1325 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4]   2> 7600 T1325 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4]   2> 7600 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
> [junit4:junit4]   2> 7614 T1325 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4]   2> 7633 T1325 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:63821/solr
> [junit4:junit4]   2> 7633 T1325 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4]   2> 7633 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@de54be
> [junit4:junit4]   2> 7636 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 7637 T1393 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 7637 T1393 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
> [junit4:junit4]   2> 7638 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63863
> [junit4:junit4]   2> 7638 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63863
> [junit4:junit4]   2> 7651 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a0009 with negotiated timeout 20000 for client /127.0.0.1:63863
> [junit4:junit4]   2> 7651 T1393 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a0009, negotiated timeout = 20000
> [junit4:junit4]   2> 7652 T1394 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@de54be name:ZooKeeperConnection Watcher:127.0.0.1:63821 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 7652 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 7654 T1330 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bab4afe6a0009
> [junit4:junit4]   2> 7655 T1327 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:63863 which had sessionid 0x13bab4afe6a0009
> [junit4:junit4]   2> 7656 T1325 oaz.ZooKeeper.close Session: 0x13bab4afe6a0009 closed
> [junit4:junit4]   2> 7656 T1394 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 7656 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
> [junit4:junit4]   2> 7662 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@384418
> [junit4:junit4]   2> 7664 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 7665 T1395 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 7665 T1395 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
> [junit4:junit4]   2> 7665 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63866
> [junit4:junit4]   2> 7666 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63866
> [junit4:junit4]   2> 7668 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a000a with negotiated timeout 20000 for client /127.0.0.1:63866
> [junit4:junit4]   2> 7668 T1395 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a000a, negotiated timeout = 20000
> [junit4:junit4]   2> 7668 T1396 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@384418 name:ZooKeeperConnection Watcher:127.0.0.1:63821/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 7668 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 7669 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a000a type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 7670 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a000a type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 7672 T1325 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63858_
> [junit4:junit4]   2> 7673 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a000a type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:63858_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:63858_
> [junit4:junit4]   2> 7674 T1325 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63858_
> [junit4:junit4]   2> 7678 T1381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 7678 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 7680 T1353 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4]   2> 7680 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 7680 T1366 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4]   2> 7680 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 7682 T1381 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4]   2> 7683 T1347 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4]   2> 7687 T1325 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4:junit4]   2> 7694 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 7706 T1348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":"4",
> [junit4:junit4]   2> 	  "shard":"shard2",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:63849_",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:63849"}
> [junit4:junit4]   2> 7708 T1397 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163\collection1
> [junit4:junit4]   2> 7709 T1397 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4]   2> 7711 T1397 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4]   2> 7711 T1397 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4]   2> 7715 T1397 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163\collection1\'
> [junit4:junit4]   2> 7717 T1397 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163/collection1/lib/classes/' to classloader
> [junit4:junit4]   2> 7718 T1397 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163/collection1/lib/README' to classloader
> [junit4:junit4]   2> 7727 T1381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 7728 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 7728 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 7728 T1396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 7735 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 7775 T1397 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
> [junit4:junit4]   2> 7846 T1397 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4]   2> 7847 T1397 oass.IndexSchema.readSchema Reading Solr Schema
> [junit4:junit4]   2> 7853 T1397 oass.IndexSchema.readSchema Schema name=test
> [junit4:junit4]   2> 8468 T1397 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4]   2> 8472 T1397 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4]   2> 8509 T1397 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty3-1355788524163\collection1\, dataDir=.\org.apache.solr.cloud.ShardRoutingTest-1355788516960/jetty3\
> [junit4:junit4]   2> 8510 T1397 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d35dc5
> [junit4:junit4]   2> 8510 T1397 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
> [junit4:junit4]   2> 8511 T1397 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty3 forceNew:false
> [junit4:junit4]   2> 8512 T1397 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty3
> [junit4:junit4]   2> 8512 T1397 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ShardRoutingTest-1355788516960/jetty3\index/
> [junit4:junit4]   2> 8513 T1397 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty3\index' doesn't exist. Creating new index...
> [junit4:junit4]   2> 8514 T1397 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty3\index forceNew:false
> [junit4:junit4]   2> 8523 T1397 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty3\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@778ca2; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 8523 T1397 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
> [junit4:junit4]   2> 8525 T1397 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty3\index
> [junit4:junit4]   2> 8525 T1397 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
> [junit4:junit4]   2> 8527 T1397 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4]   2> 8527 T1397 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4]   2> 8527 T1397 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4]   2> 8528 T1397 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
> [junit4:junit4]   2> 8528 T1397 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4]   2> 8528 T1397 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4]   2> 8529 T1397 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4]   2> 8529 T1397 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4]   2> 8530 T1397 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4]   2> 8531 T1397 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
> [junit4:junit4]   2> 8532 T1397 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4]   2> 8532 T1397 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   2> 8533 T1397 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
> [junit4:junit4]   2> 8533 T1397 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4]   2> 8534 T1397 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
> [junit4:junit4]   2> 8535 T1397 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4]   2> 8536 T1397 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 8536 T1397 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 8537 T1397 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 8538 T1397 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 8538 T1397 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 8539 T1397 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 8540 T1397 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 8541 T1397 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 8541 T1397 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4]   2> 8542 T1397 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4]   2> 8553 T1397 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4]   2> 8558 T1397 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
> [junit4:junit4]   2> 8560 T1397 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
> [junit4:junit4]   2> 8562 T1397 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty3
> [junit4:junit4]   2> 8564 T1397 oass.SolrIndexSearcher.<init> Opening Searcher@129810f main
> [junit4:junit4]   2> 8566 T1397 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4]   2> 8566 T1397 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4]   2> 8567 T1397 oashc.SpellCheckComponent.inform Initializing spell checkers
> [junit4:junit4]   2> 8579 T1397 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
> [junit4:junit4]   2> 8674 T1398 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@129810f main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   2> 8678 T1397 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4]   2> 8678 T1397 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 8748 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 8749 T1348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":"4",
> [junit4:junit4]   2> 	  "shard":null,
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:63858_",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:63858"}
> [junit4:junit4]   2> 8750 T1348 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=4
> [junit4:junit4]   2> 8750 T1348 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
> [junit4:junit4]   2> 8759 T1381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 8759 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 8760 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 8761 T1396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 8762 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 9182 T1397 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4]   2> 9183 T1397 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:63858 shardId:shard3
> [junit4:junit4]   2> 9185 T1397 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
> [junit4:junit4]   2> 9207 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a000a type:delete cxid:0x50 zxid:0xa0 txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard3 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard3
> [junit4:junit4]   2> 9210 T1397 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
> [junit4:junit4]   2> 9211 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a000a type:create cxid:0x51 zxid:0xa1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 9219 T1397 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4:junit4]   2> 9219 T1397 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4:junit4]   2> 9221 T1397 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:63858/collection1/
> [junit4:junit4]   2> 9221 T1397 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4:junit4]   2> 9221 T1397 oasc.SyncStrategy.syncToMe http://127.0.0.1:63858/collection1/ has no replicas
> [junit4:junit4]   2> 9222 T1397 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:63858/collection1/
> [junit4:junit4]   2> 9222 T1397 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
> [junit4:junit4]   2> 9234 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a000a type:create cxid:0x5a zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 9276 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 9308 T1381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 9308 T1396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 9309 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 9309 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 9310 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 9344 T1397 oasc.ZkController.register We are http://127.0.0.1:63858/collection1/ and leader is http://127.0.0.1:63858/collection1/
> [junit4:junit4]   2> 9344 T1397 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:63858
> [junit4:junit4]   2> 9344 T1397 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4:junit4]   2> 9344 T1397 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4]   2> 9346 T1397 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 9351 T1397 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 9353 T1325 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
> [junit4:junit4]   2> 9355 T1325 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4]   2> 9355 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 9701 T1325 oejs.Server.doStart jetty-8.1.8.v20121106
> [junit4:junit4]   2> 9706 T1325 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63867
> [junit4:junit4]   2> 9707 T1325 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 9707 T1325 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331
> [junit4:junit4]   2> 9707 T1325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331\'
> [junit4:junit4]   2> 9749 T1325 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4]   2> 9750 T1325 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 9750 T1325 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331
> [junit4:junit4]   2> 9750 T1325 oasc.CoreContainer$Initializer.initialize looking for solr.xml: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331\solr.xml
> [junit4:junit4]   2> 9751 T1325 oasc.CoreContainer.<init> New CoreContainer 18838579
> [junit4:junit4]   2> 9751 T1325 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331\'
> [junit4:junit4]   2> 9752 T1325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331\'
> [junit4:junit4]   2> 9776 T1325 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
> [junit4:junit4]   2> 9776 T1325 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4]   2> 9776 T1325 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4]   2> 9777 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4]   2> 9777 T1325 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4]   2> 9778 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4]   2> 9778 T1325 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4]   2> 9778 T1325 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4]   2> 9779 T1325 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4]   2> 9779 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
> [junit4:junit4]   2> 9794 T1325 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4]   2> 9827 T1325 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:63821/solr
> [junit4:junit4]   2> 9828 T1325 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4]   2> 9828 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@2ad05d
> [junit4:junit4]   2> 9832 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 9835 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 9836 T1348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":"4",
> [junit4:junit4]   2> 	  "shard":"shard3",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:63858_",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:63858"}
> [junit4:junit4]   2> 9842 T1408 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 9843 T1408 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
> [junit4:junit4]   2> 9844 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63872
> [junit4:junit4]   2> 9844 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63872
> [junit4:junit4]   2> 9893 T1408 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a000b, negotiated timeout = 20000
> [junit4:junit4]   2> 9894 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a000b with negotiated timeout 20000 for client /127.0.0.1:63872
> [junit4:junit4]   2> 9895 T1409 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ad05d name:ZooKeeperConnection Watcher:127.0.0.1:63821 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 9895 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 9900 T1330 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bab4afe6a000b
> [junit4:junit4]   2> 9904 T1327 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:63872 which had sessionid 0x13bab4afe6a000b
> [junit4:junit4]   2> 9905 T1325 oaz.ZooKeeper.close Session: 0x13bab4afe6a000b closed
> [junit4:junit4]   2> 9905 T1325 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
> [junit4:junit4]   2> 9910 T1325 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:63821/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@f60ab9
> [junit4:junit4]   2> 9914 T1396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 9914 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 9915 T1409 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 9915 T1381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 9915 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 9916 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 9916 T1325 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 9923 T1410 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:63821. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4]   2> 9923 T1410 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:63821, initiating session
> [junit4:junit4]   2> 9924 T1327 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:63875
> [junit4:junit4]   2> 9925 T1327 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:63875
> [junit4:junit4]   2> 9928 T1410 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:63821, sessionid = 0x13bab4afe6a000c, negotiated timeout = 20000
> [junit4:junit4]   2> 9928 T1329 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bab4afe6a000c with negotiated timeout 20000 for client /127.0.0.1:63875
> [junit4:junit4]   2> 9928 T1411 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f60ab9 name:ZooKeeperConnection Watcher:127.0.0.1:63821/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 9930 T1325 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 9941 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a000c type:create cxid:0x1 zxid:0xb5 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 9944 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a000c type:create cxid:0x2 zxid:0xb6 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 9946 T1325 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63867_
> [junit4:junit4]   2> 9947 T1330 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bab4afe6a000c type:delete cxid:0x4 zxid:0xb7 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:63867_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:63867_
> [junit4:junit4]   2> 9948 T1325 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63867_
> [junit4:junit4]   2> 9954 T1396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 9954 T1381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 9955 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 9958 T1366 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4]   2> 9958 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 9959 T1353 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4]   2> 9960 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 9965 T1396 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4]   2> 9966 T1381 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4]   2> 9967 T1347 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4]   2> 9971 T1325 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4:junit4]   2> 9980 T1412 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331\collection1
> [junit4:junit4]   2> 9980 T1412 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4]   2> 9982 T1412 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4]   2> 9982 T1412 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4]   2> 9984 T1412 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331\collection1\'
> [junit4:junit4]   2> 9986 T1412 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331/collection1/lib/classes/' to classloader
> [junit4:junit4]   2> 9987 T1412 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331/collection1/lib/README' to classloader
> [junit4:junit4]   2> 10041 T1412 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
> [junit4:junit4]   2> 10119 T1412 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4]   2> 10122 T1412 oass.IndexSchema.readSchema Reading Solr Schema
> [junit4:junit4]   2> 10126 T1412 oass.IndexSchema.readSchema Schema name=test
> [junit4:junit4]   2> 10703 T1412 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4]   2> 10707 T1412 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4]   2> 10742 T1412 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-jetty4-1355788526331\collection1\, dataDir=.\org.apache.solr.cloud.ShardRoutingTest-1355788516960/jetty4\
> [junit4:junit4]   2> 10742 T1412 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d35dc5
> [junit4:junit4]   2> 10743 T1412 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
> [junit4:junit4]   2> 10744 T1412 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty4 forceNew:false
> [junit4:junit4]   2> 10744 T1412 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty4
> [junit4:junit4]   2> 10745 T1412 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ShardRoutingTest-1355788516960/jetty4\index/
> [junit4:junit4]   2> 10746 T1412 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty4\index' doesn't exist. Creating new index...
> [junit4:junit4]   2> 10746 T1412 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty4\index forceNew:false
> [junit4:junit4]   2> 10755 T1412 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty4\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@12e86ed; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 10755 T1412 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
> [junit4:junit4]   2> 10757 T1412 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty4\index
> [junit4:junit4]   2> 10757 T1412 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
> [junit4:junit4]   2> 10759 T1412 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4]   2> 10759 T1412 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4]   2> 10760 T1412 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4]   2> 10760 T1412 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
> [junit4:junit4]   2> 10760 T1412 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4]   2> 10761 T1412 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4]   2> 10761 T1412 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4]   2> 10762 T1412 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4]   2> 10763 T1412 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4]   2> 10763 T1412 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
> [junit4:junit4]   2> 10764 T1412 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4]   2> 10764 T1412 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   2> 10765 T1412 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
> [junit4:junit4]   2> 10765 T1412 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4]   2> 10766 T1412 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
> [junit4:junit4]   2> 10766 T1412 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4]   2> 10767 T1412 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 10768 T1412 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 10769 T1412 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 10769 T1412 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 10770 T1412 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 10771 T1412 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 10772 T1412 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 10772 T1412 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 10773 T1412 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4]   2> 10774 T1412 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4]   2> 10786 T1412 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4]   2> 10791 T1412 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
> [junit4:junit4]   2> 10793 T1412 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
> [junit4:junit4]   2> 10795 T1412 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardRoutingTest-1355788516960\jetty4
> [junit4:junit4]   2> 10796 T1412 oass.SolrIndexSearcher.<init> Opening Searcher@1946aa7 main
> [junit4:junit4]   2> 10797 T1412 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4]   2> 10798 T1412 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4]   2> 10799 T1412 oashc.SpellCheckComponent.inform Initializing spell checkers
> [junit4:junit4]   2> 10809 T1412 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
> [junit4:junit4]   2> 10868 T1413 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1946aa7 main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   2> 10873 T1412 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4]   2> 10873 T1412 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 10973 T1348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 10975 T1348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":"4",
> [junit4:junit4]   2> 	  "shard":null,
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:63867_",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:63867"}
> [junit4:junit4]   2> 10975 T1348 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=4
> [junit4:junit4]   2> 10976 T1348 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard4
> [junit4:junit4]   2> 10995 T1396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 10996 T1366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 10997 T1411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 10999 T1353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 11000 T1347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstat
> 
> [...truncated too long message...]
> 
> tpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
> [junit4:junit4]    >         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)
> [junit4:junit4]    >         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
> [junit4:junit4]    >         at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
> [junit4:junit4]    >         at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
> [junit4:junit4]    >         at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
> [junit4:junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
> [junit4:junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
> [junit4:junit4]    >         at java.lang.Thread.run(Thread.java:722)
> [junit4:junit4]    >    4) Thread[id=1368, name=searcherExecutor-757-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]
> [junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
> [junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
> [junit4:junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
> [junit4:junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
> [junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
> [junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
> [junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> [junit4:junit4]    >         at java.lang.Thread.run(Thread.java:722)
> [junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([C86105B07D04D6DF]:0)
> [junit4:junit4]    > Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
> [junit4:junit4]    >    1) Thread[id=1357, name=qtp29204452-1357, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]
> [junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
> [junit4:junit4]    >         at java.lang.Thread.sleep(Thread.java:338)
> [junit4:junit4]    >         at org.apache.lucene.store.RateLimiter$SimpleRateLimiter.pause(RateLimiter.java:111)
> [junit4:junit4]    >         at org.apache.lucene.store.RateLimitedIndexOutput.flushBuffer(RateLimitedIndexOutput.java:45)
> [junit4:junit4]    >         at org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:90)
> [junit4:junit4]    >         at org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:79)
> [junit4:junit4]    >         at org.apache.lucene.store.RateLimitedIndexOutput.flush(RateLimitedIndexOutput.java:69)
> [junit4:junit4]    >         at org.apache.lucene.store.BufferedIndexOutput.close(BufferedIndexOutput.java:103)
> [junit4:junit4]    >         at org.apache.lucene.store.RateLimitedIndexOutput.close(RateLimitedIndexOutput.java:78)
> [junit4:junit4]    >         at org.apache.lucene.store.ChecksumIndexOutput.close(ChecksumIndexOutput.java:61)
> [junit4:junit4]    >         at org.apache.lucene.util.IOUtils.closeWhileHandlingException(IOUtils.java:203)
> [junit4:junit4]    >         at org.apache.lucene.index.SegmentInfos.rollbackCommit(SegmentInfos.java:853)
> [junit4:junit4]    >         at org.apache.lucene.index.SegmentInfos.finishCommit(SegmentInfos.java:932)
> [junit4:junit4]    >         at org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:2826)
> [junit4:junit4]    >         at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2815)
> [junit4:junit4]    >         at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:966)
> [junit4:junit4]    >         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:868)
> [junit4:junit4]    >         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:830)
> [junit4:junit4]    >         at org.apache.solr.update.SolrIndexWriter.close(SolrIndexWriter.java:145)
> [junit4:junit4]    >         at org.apache.solr.update.DirectUpdateHandler2.closeWriter(DirectUpdateHandler2.java:730)
> [junit4:junit4]    >         at org.apache.solr.update.DefaultSolrCoreState.closeIndexWriter(DefaultSolrCoreState.java:64)
> [junit4:junit4]    >         at org.apache.solr.update.DefaultSolrCoreState.close(DefaultSolrCoreState.java:272)
> [junit4:junit4]    >         at org.apache.solr.core.SolrCore.decrefSolrCoreState(SolrCore.java:883)
> [junit4:junit4]    >         at org.apache.solr.core.SolrCore.close(SolrCore.java:975)
> [junit4:junit4]    >         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:308)
> [junit4:junit4]    >         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
> [junit4:junit4]    >         at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:116)
> [junit4:junit4]    >         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
> [junit4:junit4]    >         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
> [junit4:junit4]    >         at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
> [junit4:junit4]    >         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
> [junit4:junit4]    >         at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
> [junit4:junit4]    >         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
> [junit4:junit4]    >         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
> [junit4:junit4]    >         at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
> [junit4:junit4]    >         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
> [junit4:junit4]    >         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
> [junit4:junit4]    >         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
> [junit4:junit4]    >         at org.eclipse.jetty.server.Server.handle(Server.java:365)
> [junit4:junit4]    >         at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
> [junit4:junit4]    >         at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
> [junit4:junit4]    >         at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
> [junit4:junit4]    >         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)
> [junit4:junit4]    >         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
> [junit4:junit4]    >         at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
> [junit4:junit4]    >         at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
> [junit4:junit4]    >         at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
> [junit4:junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
> [junit4:junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
> [junit4:junit4]    >         at java.lang.Thread.run(Thread.java:722)
> [junit4:junit4]    >    2) Thread[id=1368, name=searcherExecutor-757-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]
> [junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
> [junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
> [junit4:junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
> [junit4:junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
> [junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
> [junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
> [junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> [junit4:junit4]    >         at java.lang.Thread.run(Thread.java:722)
> [junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([C86105B07D04D6DF]:0)
> [junit4:junit4] Completed in 411.58s, 1 test, 2 failures, 2 errors <<< FAILURES!
> 
> [...truncated 553 lines...]
> BUILD FAILED
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:353: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:178: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:438: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1175: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:840: There were test failures: 243 suites, 1010 tests, 3 suite-level errors, 1 failure, 699 ignored
> 
> Total time: 34 minutes 24 seconds
> Build step 'Invoke Ant' marked build as failure
> Archiving artifacts
> Recording test results
> Description set: Java: 32bit/jdk1.7.0_09 -server -XX:+UseConcMarkSweepGC
> Email was triggered for: Failure
> Sending email for trigger: Failure
> 
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org