You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2015/12/14 01:10:32 UTC

[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.8.0) - Build # 2939 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/2939/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseSerialGC

2 tests failed.
FAILED:  org.apache.solr.TestDistributedSearch.test

Error Message:
Error from server at http://127.0.0.1:59550/loix/yb/collection1: java.lang.NullPointerException  at org.apache.solr.search.grouping.distributed.responseprocessor.TopGroupsShardResponseProcessor.process(TopGroupsShardResponseProcessor.java:105)  at org.apache.solr.handler.component.QueryComponent.handleGroupedResponses(QueryComponent.java:746)  at org.apache.solr.handler.component.QueryComponent.handleResponses(QueryComponent.java:729)  at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:406)  at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:156)  at org.apache.solr.core.SolrCore.execute(SolrCore.java:2070)  at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:658)  at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:457)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:222)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:181)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:111)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)  at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:45)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)  at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)  at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)  at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1158)  at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)  at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)  at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1090)  at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)  at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:437)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)  at org.eclipse.jetty.server.Server.handle(Server.java:517)  at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:308)  at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:242)  at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:261)  at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)  at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:75)  at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:213)  at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:147)  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)  at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)  at java.lang.Thread.run(Thread.java:745) 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:59550/loix/yb/collection1: java.lang.NullPointerException
	at org.apache.solr.search.grouping.distributed.responseprocessor.TopGroupsShardResponseProcessor.process(TopGroupsShardResponseProcessor.java:105)
	at org.apache.solr.handler.component.QueryComponent.handleGroupedResponses(QueryComponent.java:746)
	at org.apache.solr.handler.component.QueryComponent.handleResponses(QueryComponent.java:729)
	at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:406)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:156)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2070)
	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:658)
	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:457)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:222)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:181)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:111)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
	at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:45)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1158)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1090)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:437)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)
	at org.eclipse.jetty.server.Server.handle(Server.java:517)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:308)
	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:242)
	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:261)
	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:75)
	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:213)
	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:147)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
	at java.lang.Thread.run(Thread.java:745)

	at __randomizedtesting.SeedInfo.seed([99A2D66B45C8036E:11F6E9B1EB346E96]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
	at org.apache.solr.TestDistributedSearch.queryRandomUpServer(TestDistributedSearch.java:1138)
	at org.apache.solr.TestDistributedSearch.queryPartialResults(TestDistributedSearch.java:1100)
	at org.apache.solr.TestDistributedSearch.test(TestDistributedSearch.java:973)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:987)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.TestMiniSolrCloudCluster.testCollectionCreateSearchDelete

Error Message:
Error from server at http://127.0.0.1:58647/solr: collection already exists: testcollection

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:58647/solr: collection already exists: testcollection
	at __randomizedtesting.SeedInfo.seed([99A2D66B45C8036E:3A5878CEC220E9CB]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.MiniSolrCloudCluster.makeCollectionsRequest(MiniSolrCloudCluster.java:416)
	at org.apache.solr.cloud.MiniSolrCloudCluster.createCollection(MiniSolrCloudCluster.java:400)
	at org.apache.solr.cloud.TestMiniSolrCloudCluster.createCollection(TestMiniSolrCloudCluster.java:107)
	at org.apache.solr.cloud.TestMiniSolrCloudCluster.testCollectionCreateSearchDelete(TestMiniSolrCloudCluster.java:141)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 10287 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestMiniSolrCloudCluster
   [junit4]   2> 1361021 INFO  (TEST-TestMiniSolrCloudCluster.testExtraFilters-seed#[99A2D66B45C8036E]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1361021 INFO  (Thread-3764) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1361021 INFO  (Thread-3764) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1361123 INFO  (TEST-TestMiniSolrCloudCluster.testExtraFilters-seed#[99A2D66B45C8036E]) [    ] o.a.s.c.ZkTestServer start zk server on port:58529
   [junit4]   2> 1361123 INFO  (TEST-TestMiniSolrCloudCluster.testExtraFilters-seed#[99A2D66B45C8036E]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1361124 INFO  (TEST-TestMiniSolrCloudCluster.testExtraFilters-seed#[99A2D66B45C8036E]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1361149 INFO  (zkCallback-1612-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@e8ff925 name:ZooKeeperConnection Watcher:127.0.0.1:58529 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1361149 INFO  (TEST-TestMiniSolrCloudCluster.testExtraFilters-seed#[99A2D66B45C8036E]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1361149 INFO  (TEST-TestMiniSolrCloudCluster.testExtraFilters-seed#[99A2D66B45C8036E]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1361149 INFO  (TEST-TestMiniSolrCloudCluster.testExtraFilters-seed#[99A2D66B45C8036E]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr/solr.xml
   [junit4]   2> 1361216 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x1519db4ceb80000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1361222 INFO  (jetty-launcher-1611-thread-1) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 1361235 INFO  (jetty-launcher-1611-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4d3f3628{/solr,null,AVAILABLE}
   [junit4]   2> 1361235 INFO  (jetty-launcher-1611-thread-2) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 1361240 INFO  (jetty-launcher-1611-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@397efb28{/solr,null,AVAILABLE}
   [junit4]   2> 1361241 INFO  (jetty-launcher-1611-thread-2) [    ] o.e.j.s.ServerConnector Started ServerConnector@3129dcc0{HTTP/1.1,[http/1.1]}{127.0.0.1:58532}
   [junit4]   2> 1361241 INFO  (jetty-launcher-1611-thread-2) [    ] o.e.j.s.Server Started @1365187ms
   [junit4]   2> 1361241 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=58532}
   [junit4]   2> 1361241 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@74a14482
   [junit4]   2> 1361241 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node2'
   [junit4]   2> 1361241 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1361241 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1361241 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1361247 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1361249 INFO  (jetty-launcher-1611-thread-1) [    ] o.e.j.s.ServerConnector Started ServerConnector@340fb25c{HTTP/1.1,[http/1.1]}{127.0.0.1:58531}
   [junit4]   2> 1361249 INFO  (jetty-launcher-1611-thread-1) [    ] o.e.j.s.Server Started @1365195ms
   [junit4]   2> 1361249 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=58531}
   [junit4]   2> 1361249 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@74a14482
   [junit4]   2> 1361249 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node1'
   [junit4]   2> 1361249 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1361249 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1361250 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1361251 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1361251 INFO  (jetty-launcher-1611-thread-3) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 1361259 INFO  (jetty-launcher-1611-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6ca140e7{/solr,null,AVAILABLE}
   [junit4]   2> 1361259 INFO  (jetty-launcher-1611-thread-3) [    ] o.e.j.s.ServerConnector Started ServerConnector@21f19184{HTTP/1.1,[http/1.1]}{127.0.0.1:58535}
   [junit4]   2> 1361259 INFO  (jetty-launcher-1611-thread-3) [    ] o.e.j.s.Server Started @1365206ms
   [junit4]   2> 1361259 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=58535}
   [junit4]   2> 1361259 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@74a14482
   [junit4]   2> 1361259 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node3'
   [junit4]   2> 1361260 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1361260 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1361260 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1361269 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1361271 INFO  (jetty-launcher-1611-thread-4) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 1361273 INFO  (jetty-launcher-1611-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6f24b5d4{/solr,null,AVAILABLE}
   [junit4]   2> 1361274 INFO  (jetty-launcher-1611-thread-4) [    ] o.e.j.s.ServerConnector Started ServerConnector@6ceb9ea0{HTTP/1.1,[http/1.1]}{127.0.0.1:58537}
   [junit4]   2> 1361274 INFO  (jetty-launcher-1611-thread-4) [    ] o.e.j.s.Server Started @1365220ms
   [junit4]   2> 1361274 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=58537}
   [junit4]   2> 1361274 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@74a14482
   [junit4]   2> 1361274 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node5'
   [junit4]   2> 1361274 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1361274 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1361275 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1361275 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1361278 INFO  (jetty-launcher-1611-thread-5) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 1361280 INFO  (jetty-launcher-1611-thread-5) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@780ab1b4{/solr,null,AVAILABLE}
   [junit4]   2> 1361281 INFO  (jetty-launcher-1611-thread-5) [    ] o.e.j.s.ServerConnector Started ServerConnector@186261a8{HTTP/1.1,[http/1.1]}{127.0.0.1:58539}
   [junit4]   2> 1361281 INFO  (jetty-launcher-1611-thread-5) [    ] o.e.j.s.Server Started @1365227ms
   [junit4]   2> 1361281 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=58539}
   [junit4]   2> 1361281 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@74a14482
   [junit4]   2> 1361281 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node4'
   [junit4]   2> 1361281 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1361281 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1361281 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1361282 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1361283 INFO  (zkCallback-1613-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@329a54f7 name:ZooKeeperConnection Watcher:127.0.0.1:58529/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1361284 INFO  (zkCallback-1614-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@329e41aa name:ZooKeeperConnection Watcher:127.0.0.1:58529/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1361285 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1361285 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1361286 INFO  (zkCallback-1615-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@56002c99 name:ZooKeeperConnection Watcher:127.0.0.1:58529/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1361286 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1361286 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1361286 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1361287 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1361295 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1361296 INFO  (zkCallback-1616-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@15d1dc9d name:ZooKeeperConnection Watcher:127.0.0.1:58529/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1361296 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1361296 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1361297 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1361297 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1361311 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1361327 INFO  (zkCallback-1617-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5f2fc130 name:ZooKeeperConnection Watcher:127.0.0.1:58529/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1361329 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1361329 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1361330 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node5/.
   [junit4]   2> 1361330 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.c.CoreContainer New CoreContainer 1071907399
   [junit4]   2> 1361330 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node5]
   [junit4]   2> 1361330 WARN  (jetty-launcher-1611-thread-4) [    ] o.a.s.c.CoreContainer Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node5/lib to classpath: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node5/lib
   [junit4]   2> 1361331 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1361331 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1361333 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1361333 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1361333 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58529/solr
   [junit4]   2> 1361333 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1361333 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1361334 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1361337 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1361337 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node1/.
   [junit4]   2> 1361337 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.c.CoreContainer New CoreContainer 1453009121
   [junit4]   2> 1361337 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node1]
   [junit4]   2> 1361337 WARN  (jetty-launcher-1611-thread-1) [    ] o.a.s.c.CoreContainer Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node1/lib to classpath: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node1/lib
   [junit4]   2> 1361338 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1361338 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1361339 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1361339 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1361339 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58529/solr
   [junit4]   2> 1361339 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1361339 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1361340 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1361342 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node3/.
   [junit4]   2> 1361342 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.c.CoreContainer New CoreContainer 1454624191
   [junit4]   2> 1361342 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node3]
   [junit4]   2> 1361342 WARN  (jetty-launcher-1611-thread-3) [    ] o.a.s.c.CoreContainer Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node3/lib to classpath: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node3/lib
   [junit4]   2> 1361342 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1361343 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1361343 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1361343 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1361343 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58529/solr
   [junit4]   2> 1361343 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1361343 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1361371 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1361372 INFO  (zkCallback-1619-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2129e7d9 name:ZooKeeperConnection Watcher:127.0.0.1:58529 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1361373 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1361373 INFO  (zkCallback-1621-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7a31d2be name:ZooKeeperConnection Watcher:127.0.0.1:58529 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1361373 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1361374 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1361374 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1361379 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node2/.
   [junit4]   2> 1361380 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.c.CoreContainer New CoreContainer 1432456017
   [junit4]   2> 1361380 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node2]
   [junit4]   2> 1361380 WARN  (jetty-launcher-1611-thread-2) [    ] o.a.s.c.CoreContainer Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node2/lib to classpath: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node2/lib
   [junit4]   2> 1361380 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1361381 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1361381 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1361381 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1361381 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58529/solr
   [junit4]   2> 1361381 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1361381 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1361387 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1361391 INFO  (zkCallback-1623-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@30819d11 name:ZooKeeperConnection Watcher:127.0.0.1:58529 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1361392 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1361392 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1361395 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node4/.
   [junit4]   2> 1361396 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.c.CoreContainer New CoreContainer 2050258790
   [junit4]   2> 1361396 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node4]
   [junit4]   2> 1361397 WARN  (jetty-launcher-1611-thread-5) [    ] o.a.s.c.CoreContainer Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node4/lib to classpath: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node4/lib
   [junit4]   2> 1361397 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1361400 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1361402 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1361402 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1361402 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58529/solr
   [junit4]   2> 1361402 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1361402 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1361415 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1361416 INFO  (zkCallback-1625-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@18a1451e name:ZooKeeperConnection Watcher:127.0.0.1:58529 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1361416 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1361416 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1361424 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1361425 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1361432 INFO  (zkCallback-1627-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5be47a29 name:ZooKeeperConnection Watcher:127.0.0.1:58529 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1361433 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1361433 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1361451 INFO  (zkCallback-1629-thread-1-processing-n:127.0.0.1:58537_solr) [n:127.0.0.1:58537_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5d55410d name:ZooKeeperConnection Watcher:127.0.0.1:58529/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1361452 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1361471 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1361471 INFO  (zkCallback-1628-thread-1-processing-n:127.0.0.1:58531_solr) [n:127.0.0.1:58531_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@113df0d4 name:ZooKeeperConnection Watcher:127.0.0.1:58529/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1361472 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1361474 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1361479 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1361489 INFO  (zkCallback-1630-thread-1-processing-n:127.0.0.1:58535_solr) [n:127.0.0.1:58535_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@10136c9e name:ZooKeeperConnection Watcher:127.0.0.1:58529/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1361489 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1361497 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1361498 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1361498 INFO  (zkCallback-1631-thread-1-processing-n:127.0.0.1:58532_solr) [n:127.0.0.1:58532_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@50e00ae6 name:ZooKeeperConnection Watcher:127.0.0.1:58529/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1361498 INFO  (zkCallback-1632-thread-1-processing-n:127.0.0.1:58539_solr) [n:127.0.0.1:58539_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4284c99b name:ZooKeeperConnection Watcher:127.0.0.1:58529/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1361498 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1361498 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1361513 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1361514 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1361541 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1361555 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1361561 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1361643 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1361653 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1361654 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1361655 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1361683 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1361683 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1361703 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1361707 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1361741 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1361748 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1361750 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1361751 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1361808 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1361819 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1361820 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1361821 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1361873 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1361873 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1361883 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1361883 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1361889 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1361890 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1361907 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1361908 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1361908 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1361909 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1361909 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1361931 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1361932 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1361932 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1361932 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1361973 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58537_solr
   [junit4]   2> 1361973 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58531_solr
   [junit4]   2> 1361973 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58535_solr
   [junit4]   2> 1361973 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58539_solr
   [junit4]   2> 1361975 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58532_solr
   [junit4]   2> 1361992 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:58537_solr
   [junit4]   2> 1361993 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:58531_solr
   [junit4]   2> 1361996 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:58539_solr
   [junit4]   2> 1361998 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:58535_solr
   [junit4]   2> 1361999 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:58532_solr
   [junit4]   2> 1362003 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1362012 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1362013 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1362014 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1362019 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1362020 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1362022 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1362022 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1362024 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1362026 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95030467039330319-127.0.0.1:58539_solr-n_0000000000
   [junit4]   2> 1362027 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95030467039330317-127.0.0.1:58535_solr-n_0000000001
   [junit4]   2> 1362027 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95030467039330318-127.0.0.1:58532_solr-n_0000000002
   [junit4]   2> 1362029 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1362029 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:58539_solr
   [junit4]   2> 1362029 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1362033 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95030467039330316-127.0.0.1:58537_solr-n_0000000003
   [junit4]   2> 1362035 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95030467039330315-127.0.0.1:58531_solr-n_0000000004
   [junit4]   2> 1362038 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95030467039330317-127.0.0.1:58535_solr-n_0000000001 to know if I could be the leader
   [junit4]   2> 1362038 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1362038 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95030467039330319-127.0.0.1:58539_solr-n_0000000000 to know if I could be the leader
   [junit4]   2> 1362038 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1362041 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95030467039330318-127.0.0.1:58532_solr-n_0000000002 to know if I could be the leader
   [junit4]   2> 1362041 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1362047 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95030467039330316-127.0.0.1:58537_solr-n_0000000003 to know if I could be the leader
   [junit4]   2> 1362048 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1362054 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1362054 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1362059 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node5/.
   [junit4]   2> 1362060 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
   [junit4]   2> 1362062 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.Overseer Overseer (id=95030467039330319-127.0.0.1:58539_solr-n_0000000000) starting
   [junit4]   2> 1362062 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1362062 INFO  (jetty-launcher-1611-thread-4) [n:127.0.0.1:58537_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1362070 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1362070 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1362071 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node3/.
   [junit4]   2> 1362071 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
   [junit4]   2> 1362077 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1362077 INFO  (jetty-launcher-1611-thread-3) [n:127.0.0.1:58535_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1362093 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1362094 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1362095 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node1/.
   [junit4]   2> 1362095 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
   [junit4]   2> 1362095 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1362096 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1362096 INFO  (jetty-launcher-1611-thread-1) [n:127.0.0.1:58531_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1362120 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1362120 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1362121 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node2/.
   [junit4]   2> 1362121 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
   [junit4]   2> 1362150 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1362150 INFO  (jetty-launcher-1611-thread-2) [n:127.0.0.1:58532_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1362257 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1362258 INFO  (OverseerStateUpdate-95030467039330319-127.0.0.1:58539_solr-n_0000000000) [n:127.0.0.1:58539_solr    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1362259 INFO  (OverseerCollectionConfigSetProcessor-95030467039330319-127.0.0.1:58539_solr-n_0000000000) [n:127.0.0.1:58539_solr    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 1362261 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1362297 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1362297 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1362298 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-001/node4/.
   [junit4]   2> 1362298 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
   [junit4]   2> 1362306 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1362306 INFO  (jetty-launcher-1611-thread-5) [n:127.0.0.1:58539_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1362307 INFO  (TEST-TestMiniSolrCloudCluster.testExtraFilters-seed#[99A2D66B45C8036E]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1362307 INFO  (TEST-TestMiniSolrCloudCluster.testExtraFilters-seed#[99A2D66B45C8036E]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1362320 INFO  (zkCallback-1633-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2563cb95 name:ZooKeeperConnection Watcher:127.0.0.1:58529 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1362320 INFO  (TEST-TestMiniSolrCloudCluster.testExtraFilters-seed#[99A2D66B45C8036E]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1362320 INFO  (TEST-TestMiniSolrCloudCluster.testExtraFilters-seed#[99A2D66B45C8036E]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1362327 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x1519db4ceb80010, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1362329 INFO  (jetty-launcher-1611-thread-4) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@186261a8{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1362329 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2050258790
   [junit4]   2> 1362335 INFO  (jetty-launcher-1611-thread-2) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@21f19184{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1362335 INFO  (jetty-launcher-1611-thread-4) [    ] o.a.s.c.Overseer Overseer (id=95030467039330319-127.0.0.1:58539_solr-n_0000000000) closing
   [junit4]   2> 1362335 INFO  (OverseerStateUpdate-95030467039330319-127.0.0.1:58539_solr-n_0000000000) [n:127.0.0.1:58539_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:58539_solr
   [junit4]   2> 1362337 INFO  (jetty-launcher-1611-thread-3) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@3129dcc0{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1362337 INFO  (jetty-launcher-1611-thread-5) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@6ceb9ea0{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1362340 INFO  (jetty-launcher-1611-thread-1) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@340fb25c{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1362341 INFO  (jetty-launcher-1611-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1453009121
   [junit4]   2> 1362351 INFO  (jetty-launcher-1611-thread-2) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1454624191
   [junit4]   2> 1362352 INFO  (jetty-launcher-1611-thread-3) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1432456017
   [junit4]   2> 1362352 INFO  (jetty-launcher-1611-thread-5) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1071907399
   [junit4]   2> 1362359 INFO  (zkCallback-1628-thread-1-processing-n:127.0.0.1:58531_solr) [n:127.0.0.1:58531_solr    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1362359 INFO  (zkCallback-1630-thread-1-processing-n:127.0.0.1:58535_solr) [n:127.0.0.1:58535_solr    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1362360 INFO  (zkCallback-1632-thread-1-processing-n:127.0.0.1:58539_solr) [n:127.0.0.1:58539_solr    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1362360 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x1519db4ceb8000b, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1362365 INFO  (zkCallback-1629-thread-1-processing-n:127.0.0.1:58537_solr) [n:127.0.0.1:58537_solr    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1362367 INFO  (zkCallback-1631-thread-1-processing-n:127.0.0.1:58532_solr) [n:127.0.0.1:58532_solr    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1362390 INFO  (zkCallback-1629-thread-1-processing-n:127.0.0.1:58537_solr) [n:127.0.0.1:58537_solr    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1362391 ERROR (jetty-launcher-1611-thread-3-EventThread) [n:127.0.0.1:58535_solr    ] o.a.z.ClientCnxn Error while calling watcher 
   [junit4]   2> java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1@338b6134 rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@7689e921[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 2]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:215)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 1363861 WARN  (zkCallback-1628-thread-1-processing-n:127.0.0.1:58531_solr) [n:127.0.0.1:58531_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1363861 WARN  (zkCallback-1632-thread-1-processing-n:127.0.0.1:58539_solr) [n:127.0.0.1:58539_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1363861 INFO  (jetty-launcher-1611-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4d3f3628{/solr,null,UNAVAILABLE}
   [junit4]   2> 1363862 INFO  (jetty-launcher-1611-thread-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@780ab1b4{/solr,null,UNAVAILABLE}
   [junit4]   2> 1363868 WARN  (zkCallback-1631-thread-1-processing-n:127.0.0.1:58532_solr) [n:127.0.0.1:58532_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1363869 INFO  (jetty-launcher-1611-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@397efb28{/solr,null,UNAVAILABLE}
   [junit4]   2> 1363877 WARN  (zkCallback-1630-thread-2-processing-n:127.0.0.1:58535_solr) [n:127.0.0.1:58535_solr    ] o.a.s.c.LeaderElector 
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:336)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:333)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:333)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:59)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:389)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:232)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1363878 INFO  (jetty-launcher-1611-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6ca140e7{/solr,null,UNAVAILABLE}
   [junit4]   2> 1363891 WARN  (zkCallback-1629-thread-1-processing-n:127.0.0.1:58537_solr) [n:127.0.0.1:58537_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1363892 WARN  (zkCallback-1629-thread-2-processing-n:127.0.0.1:58537_solr) [n:127.0.0.1:58537_solr    ] o.a.s.c.LeaderElector 
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:336)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:333)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:333)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:59)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:389)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:232)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1363892 INFO  (jetty-launcher-1611-thread-5) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6f24b5d4{/solr,null,UNAVAILABLE}
   [junit4]   2> 1363896 INFO  (TEST-TestMiniSolrCloudCluster.testExtraFilters-seed#[99A2D66B45C8036E]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:58529 58529
   [junit4]   2> 1363905 INFO  (Thread-3764) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:58529 58529
   [junit4]   2> 1365440 WARN  (Thread-3764) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/aliases.json
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/live_nodes
   [junit4]   2> 	5	/solr/collections
   [junit4]   2> 
   [junit4]   2> 1365448 INFO  (TEST-TestMiniSolrCloudCluster.testStopAllStartAll-seed#[99A2D66B45C8036E]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1365448 INFO  (Thread-3820) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1365448 INFO  (Thread-3820) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1365549 INFO  (TEST-TestMiniSolrCloudCluster.testStopAllStartAll-seed#[99A2D66B45C8036E]) [    ] o.a.s.c.ZkTestServer start zk server on port:58552
   [junit4]   2> 1365549 INFO  (TEST-TestMiniSolrCloudCluster.testStopAllStartAll-seed#[99A2D66B45C8036E]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1365552 INFO  (TEST-TestMiniSolrCloudCluster.testStopAllStartAll-seed#[99A2D66B45C8036E]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1365908 INFO  (zkCallback-1636-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@69bb20b5 name:ZooKeeperConnection Watcher:127.0.0.1:58552 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1365908 INFO  (TEST-TestMiniSolrCloudCluster.testStopAllStartAll-seed#[99A2D66B45C8036E]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1365908 INFO  (TEST-TestMiniSolrCloudCluster.testStopAllStartAll-seed#[99A2D66B45C8036E]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1365908 INFO  (TEST-TestMiniSolrCloudCluster.testStopAllStartAll-seed#[99A2D66B45C8036E]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr/solr.xml
   [junit4]   2> 1366007 INFO  (jetty-launcher-1635-thread-2) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 1366011 INFO  (jetty-launcher-1635-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@355801fc{/solr,null,AVAILABLE}
   [junit4]   2> 1366012 INFO  (jetty-launcher-1635-thread-2) [    ] o.e.j.s.ServerConnector Started ServerConnector@437652fa{HTTP/1.1,[http/1.1]}{127.0.0.1:58554}
   [junit4]   2> 1366012 INFO  (jetty-launcher-1635-thread-2) [    ] o.e.j.s.Server Started @1369959ms
   [junit4]   2> 1366012 INFO  (jetty-launcher-1635-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=58554}
   [junit4]   2> 1366012 INFO  (jetty-launcher-1635-thread-2) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@74a14482
   [junit4]   2> 1366012 INFO  (jetty-launcher-1635-thread-2) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-002/node2'
   [junit4]   2> 1366012 INFO  (jetty-launcher-1635-thread-2) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1366012 INFO  (jetty-launcher-1635-thread-2) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1366014 INFO  (jetty-launcher-1635-thread-4) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 1366018 INFO  (jetty-launcher-1635-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@22f5b14a{/solr,null,AVAILABLE}
   [junit4]   2> 1366018 INFO  (jetty-launcher-1635-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1366018 INFO  (jetty-launcher-1635-thread-4) [    ] o.e.j.s.ServerConnector Started ServerConnector@7613bd2{HTTP/1.1,[http/1.1]}{127.0.0.1:58555}
   [junit4]   2> 1366018 INFO  (jetty-launcher-1635-thread-4) [    ] o.e.j.s.Server Started @1369965ms
   [junit4]   2> 1366018 INFO  (jetty-launcher-1635-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=58555}
   [junit4]   2> 1366019 INFO  (jetty-launcher-1635-thread-4) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@74a14482
   [junit4]   2> 1366019 INFO  (jetty-launcher-1635-thread-4) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-002/node4'
   [junit4]   2> 1366019 INFO  (jetty-launcher-1635-thread-4) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1366019 INFO  (jetty-launcher-1635-thread-4) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1366019 INFO  (jetty-launcher-1635-thread-4) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1366020 INFO  (jetty-launcher-1635-thread-2) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1366021 INFO  (jetty-launcher-1635-thread-4) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1366023 INFO  (jetty-launcher-1635-thread-3) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 1366023 INFO  (jetty-launcher-1635-thread-1) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 1366025 INFO  (jetty-launcher-1635-thread-5) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 1366029 INFO  (jetty-launcher-1635-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@ac9ce91{/solr,null,AVAILABLE}
   [junit4]   2> 1366030 INFO  (jetty-launcher-1635-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1886bed{/solr,null,AVAILABLE}
   [junit4]   2> 1366030 INFO  (jetty-launcher-1635-thread-3) [    ] o.e.j.s.ServerConnector Started ServerConnector@71c1abc9{HTTP/1.1,[http/1.1]}{127.0.0.1:58558}
   [junit4]   2> 1366030 INFO  (jetty-launcher-1635-thread-3) [    ] o.e.j.s.Server Started @1369977ms
   [junit4]   2> 1366030 INFO  (jetty-launcher-1635-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=58558}
   [junit4]   2> 1366030 INFO  (jetty-launcher-1635-thread-1) [    ] o.e.j.s.ServerConnector Started ServerConnector@3a9c2a93{HTTP/1.1,[http/1.1]}{127.0.0.1:58559}
   [junit4]   2> 1366030 INFO  (jetty-launcher-1635-thread-3) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@74a14482
   [junit4]   2> 1366030 INFO  (jetty-launcher-1635-thread-1) [    ] o.e.j.s.Server Started @1369977ms
   [junit4]   2> 1366030 INFO  (jetty-launcher-1635-thread-3) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster_99A2D66B45C8036E-001/tempDir-002/node3'
   [junit4]   2> 1366030 INFO  (jetty-launcher-1635-thread-3) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1366030 INFO  (jetty-launcher-1635-thread-3) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1366030 INFO  (jetty-launcher-1635-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=58559}
   [junit4]   2> 1366031 INFO  (jetty-launcher-1635-thread-1) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@74a14482
   [junit4]   2> 1366032 INFO  (jetty-launcher-1635-thread-5) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@daf59bb{/solr,null,AVAILABLE}
   [junit4]   2> 1366032 INFO  (jetty-launcher-1635-thread-5) [    ] o.e.j.s.ServerConnector Started ServerConnector@79494b61{HTTP/1.1,[http/1.1]}{127.0.0.1:58560}
   [junit4]   2> 1366032 INFO  (jetty-launcher-1635-thread-5) [    ] o.e.j.s.Server Started @1369979ms
   [junit4]   2> 1366032 INFO  (jetty-launcher-1635-thread-5) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=58560}
   [junit4]   2> 1366032 INFO  (jetty-launcher-1635-thread-5) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@74a14482
   [junit4]   2> 1366032 INFO  (jetty-launcher-1635-thread-5) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Sol

[...truncated too long message...]

 > 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)
   [junit4]    > 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]    > 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1090)
   [junit4]    > 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]    > 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:437)
   [junit4]    > 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)
   [junit4]    > 	at org.eclipse.jetty.server.Server.handle(Server.java:517)
   [junit4]    > 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:308)
   [junit4]    > 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:242)
   [junit4]    > 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:261)
   [junit4]    > 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
   [junit4]    > 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:75)
   [junit4]    > 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:213)
   [junit4]    > 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:147)
   [junit4]    > 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
   [junit4]    > 	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([99A2D66B45C8036E:11F6E9B1EB346E96]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
   [junit4]    > 	at org.apache.solr.TestDistributedSearch.queryRandomUpServer(TestDistributedSearch.java:1138)
   [junit4]    > 	at org.apache.solr.TestDistributedSearch.queryPartialResults(TestDistributedSearch.java:1100)
   [junit4]    > 	at org.apache.solr.TestDistributedSearch.test(TestDistributedSearch.java:973)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:987)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1931385 INFO  (SUITE-TestDistributedSearch-seed#[99A2D66B45C8036E]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.TestDistributedSearch_99A2D66B45C8036E-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {other_tl1=Lucene50(blocksize=128), range_facet_l_dv=PostingsFormat(name=LuceneVarGapDocFreqInterval), SubjectTerms_mfacet=Lucene50(blocksize=128), n_l1=Lucene50(blocksize=128), a_n_tdt=PostingsFormat(name=LuceneVarGapDocFreqInterval), multiDefault=PostingsFormat(name=Direct), intDefault=Lucene50(blocksize=128), n_td1=PostingsFormat(name=Direct), n_d1=Lucene50(blocksize=128), n_f1=PostingsFormat(name=Direct), range_facet_l=Lucene50(blocksize=128), n_tl1=PostingsFormat(name=Direct), oddField_s=PostingsFormat(name=MockRandom), n_tf1=Lucene50(blocksize=128), lowerfilt1and2=PostingsFormat(name=Direct), a_t=Lucene50(blocksize=128), lowerfilt=PostingsFormat(name=Direct), id=PostingsFormat(name=LuceneVarGapDocFreqInterval), text=PostingsFormat(name=MockRandom), timestamp=Lucene50(blocksize=128), severity=PostingsFormat(name=MockRandom), foo_sev_enum=PostingsFormat(name=LuceneVarGapDocFreqInterval), n_dt1=PostingsFormat(name=Direct), a_i1=Lucene50(blocksize=128), b_n_tdt=Lucene50(blocksize=128), n_ti1=PostingsFormat(name=LuceneVarGapDocFreqInterval), rnd_b=PostingsFormat(name=LuceneVarGapDocFreqInterval), _version_=Lucene50(blocksize=128), foo_b=PostingsFormat(name=MockRandom), n_tdt1=Lucene50(blocksize=128), foo_d=PostingsFormat(name=LuceneVarGapDocFreqInterval), range_facet_i_dv=Lucene50(blocksize=128), foo_f=PostingsFormat(name=MockRandom)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Asserting), foo_sev_enum=DocValuesFormat(name=Asserting), range_facet_i_dv=DocValuesFormat(name=Lucene54), timestamp=DocValuesFormat(name=Lucene54)}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=no, timezone=Asia/Saigon
   [junit4]   2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=3,threads=1,free=145085792,total=498450432
   [junit4]   2> NOTE: All tests run in this JVM: [TestSolrQueryParserDefaultOperatorResource, RemoteQueryErrorTest, ConvertedLegacyTest, DistributedMLTComponentTest, BinaryUpdateRequestHandlerTest, TestFiltering, StatsComponentTest, ShardRoutingCustomTest, TestDefaultSearchFieldResource, HdfsChaosMonkeyNothingIsSafeTest, HdfsCollectionsAPIDistributedZkTest, ParsingFieldUpdateProcessorsTest, ActionThrottleTest, SuggestComponentTest, TestRTimerTree, BasicDistributedZk2Test, TermVectorComponentDistributedTest, TestOrdValues, TestTrie, TestSQLHandler, NumericFieldsTest, TestRemoveLastDynamicCopyField, ZkSolrClientTest, TestReRankQParserPlugin, TermVectorComponentTest, TestDefaultStatsCache, TestBlendedInfixSuggestions, TestManagedSchemaFieldResource, SpellPossibilityIteratorTest, DebugComponentTest, RankQueryTest, TestBinaryField, TestManagedSynonymFilterFactory, TestNonDefinedSimilarityFactory, TestFoldingMultitermQuery, TestRestManager, TestReloadDeadlock, DistributedFacetPivotLongTailTest, HLLUtilTest, NotRequiredUniqueKeyTest, TestSolr4Spatial, TestInitQParser, TestSolrConfigHandlerConcurrent, FullSolrCloudDistribCmdsTest, SuggesterTSTTest, TestDistributedMissingSort, DistributedQueueTest, PKIAuthenticationIntegrationTest, TestFieldResource, TestDynamicLoading, TestOmitPositions, DateFieldTest, TestDistributedGrouping, DistributedQueryComponentCustomSortTest, CollectionsAPIDistributedZkTest, TestNRTOpen, DocExpirationUpdateProcessorFactoryTest, ResponseLogComponentTest, TestQuerySenderListener, CoreAdminHandlerTest, TestCoreDiscovery, CloudExitableDirectoryReaderTest, TestRebalanceLeaders, TestIndexSearcher, OverseerRolesTest, IndexSchemaRuntimeFieldTest, TestRealTimeGet, CollectionStateFormat2Test, NoCacheHeaderTest, HdfsBasicDistributedZk2Test, DataDrivenBlockJoinTest, SolrPluginUtilsTest, TestCloudPivotFacet, FileBasedSpellCheckerTest, TestLRUStatsCache, TestRandomCollapseQParserPlugin, TestMissingGroups, DateMathParserTest, SuggesterWFSTTest, TestFilteredDocIdSet, DirectSolrConnectionTest, TestRangeQuery, TestRandomFaceting, RAMDirectoryFactoryTest, VersionInfoTest, TestScoreJoinQPNoScore, OverseerTaskQueueTest, CacheHeaderTest, OpenCloseCoreStressTest, TestUtils, LukeRequestHandlerTest, ForceLeaderTest, TestReload, BasicZkTest, FieldMutatingUpdateProcessorTest, UniqFieldsUpdateProcessorFactoryTest, SegmentsInfoRequestHandlerTest, MultiThreadedOCPTest, HighlighterMaxOffsetTest, AnalysisErrorHandlingTest, TestPKIAuthenticationPlugin, RestartWhileUpdatingTest, SolrCoreCheckLockOnStartupTest, RequestLoggingTest, TestValueSourceCache, PluginInfoTest, TestSolrJ, TestCharFilters, SpatialHeatmapFacetsTest, TestTrackingShardHandlerFactory, ZkStateReaderTest, TestSolrCoreProperties, CSVRequestHandlerTest, TestReqParamsAPI, TestSolrIndexConfig, HdfsLockFactoryTest, TestMiniSolrCloudClusterBase, TestRequestForwarding, HdfsSyncSliceTest, DistanceUnitsTest, OpenExchangeRatesOrgProviderTest, TestStressRecovery, OverriddenZkACLAndCredentialsProvidersTest, CopyFieldTest, TestSystemIdResolver, DistributedTermsComponentTest, SpellingQueryConverterTest, TestSolrDynamicMBean, TestWriterPerf, CdcrReplicationDistributedZkTest, TestManagedSchema, DeleteLastCustomShardedReplicaTest, TestEmbeddedSolrServerConstructors, TestExclusionRuleCollectionAccess, TestRecovery, TestMiniSolrCloudClusterSSL, FullHLLTest, BasicDistributedZkTest, SyncSliceTest, ShardRoutingTest, TestRandomDVFaceting, TestDistributedSearch]
   [junit4] Completed [311/566 (2!)] on J1 in 105.11s, 1 test, 1 error <<< FAILURES!

[...truncated 826 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:784: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:728: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:59: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:233: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:516: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1436: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:991: There were test failures: 566 suites (8 ignored), 2245 tests, 2 errors, 118 ignored (68 assumptions) [seed: 99A2D66B45C8036E]

Total time: 74 minutes 3 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any