You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2015/12/01 14:11:41 UTC

[JENKINS] Lucene-Solr-trunk-Solaris (64bit/jdk1.8.0) - Build # 225 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Solaris/225/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseG1GC

1 tests failed.
FAILED:  org.apache.solr.TestDistributedSearch.test

Error Message:
Error from server at http://127.0.0.1:45240//collection1: java.lang.NullPointerException  at org.apache.solr.search.grouping.distributed.responseprocessor.TopGroupsShardResponseProcessor.process(TopGroupsShardResponseProcessor.java:105)  at org.apache.solr.handler.component.QueryComponent.handleGroupedResponses(QueryComponent.java:744)  at org.apache.solr.handler.component.QueryComponent.handleResponses(QueryComponent.java:727)  at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:409)  at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:151)  at org.apache.solr.core.SolrCore.execute(SolrCore.java:2069)  at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:654)  at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:455)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:221)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:180)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:109)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)  at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:45)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)  at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)  at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)  at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1158)  at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)  at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)  at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1090)  at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)  at org.eclipse.jetty.server.Server.handle(Server.java:517)  at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:308)  at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:242)  at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:261)  at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)  at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:75)  at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:213)  at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:147)  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)  at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)  at java.lang.Thread.run(Thread.java:745) 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:45240//collection1: java.lang.NullPointerException
	at org.apache.solr.search.grouping.distributed.responseprocessor.TopGroupsShardResponseProcessor.process(TopGroupsShardResponseProcessor.java:105)
	at org.apache.solr.handler.component.QueryComponent.handleGroupedResponses(QueryComponent.java:744)
	at org.apache.solr.handler.component.QueryComponent.handleResponses(QueryComponent.java:727)
	at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:409)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:151)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2069)
	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:654)
	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:455)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:221)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:180)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:109)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
	at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:45)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1158)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1090)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)
	at org.eclipse.jetty.server.Server.handle(Server.java:517)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:308)
	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:242)
	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:261)
	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:75)
	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:213)
	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:147)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
	at java.lang.Thread.run(Thread.java:745)

	at __randomizedtesting.SeedInfo.seed([4DC776BC2100EAA6:C59349668FFC875E]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:574)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:240)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:229)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
	at org.apache.solr.TestDistributedSearch.queryRandomUpServer(TestDistributedSearch.java:1133)
	at org.apache.solr.TestDistributedSearch.queryPartialResults(TestDistributedSearch.java:1095)
	at org.apache.solr.TestDistributedSearch.test(TestDistributedSearch.java:968)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:986)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:939)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 10001 lines...]
   [junit4] Suite: org.apache.solr.TestDistributedSearch
   [junit4]   2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/init-core-data-001
   [junit4]   2> 1030295 WARN  (SUITE-TestDistributedSearch-seed#[4DC776BC2100EAA6]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4
   [junit4]   2> 1030295 INFO  (SUITE-TestDistributedSearch-seed#[4DC776BC2100EAA6]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1030296 INFO  (SUITE-TestDistributedSearch-seed#[4DC776BC2100EAA6]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 1030455 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/control/cores/collection1
   [junit4]   2> 1030456 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 1030458 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1ef5814d{/,null,AVAILABLE}
   [junit4]   2> 1030458 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.e.j.s.ServerConnector Started ServerConnector@31c2e49e{HTTP/1.1,[http/1.1]}{127.0.0.1:59025}
   [junit4]   2> 1030458 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.e.j.s.Server Started @1034448ms
   [junit4]   2> 1030458 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=59025, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/control/cores}
   [junit4]   2> 1030458 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@659e0bfd
   [junit4]   2> 1030459 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/control'
   [junit4]   2> 1030459 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1030459 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1030459 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/control/solr.xml
   [junit4]   2> 1030465 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/control/cores
   [junit4]   2> 1030465 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.CoreContainer New CoreContainer 2039429337
   [junit4]   2> 1030465 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/control]
   [junit4]   2> 1030465 WARN  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.CoreContainer Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/control/lib to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/control/lib
   [junit4]   2> 1030466 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1030468 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1030469 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1030469 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1030469 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1030469 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1030470 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.CoresLocator Looking for core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/control/cores
   [junit4]   2> 1030471 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/, configSet=collection1}
   [junit4]   2> 1030471 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.CoresLocator Found core collection1 in /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/control/cores/collection1
   [junit4]   2> 1030471 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 1030472 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.s.SolrDispatchFilter user.dir=/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0
   [junit4]   2> 1030472 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1030472 INFO  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1'
   [junit4]   2> 1030473 INFO  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1030473 INFO  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1030473 INFO  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.c.SolrResourceLoader Adding 'file:/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 1030473 INFO  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.c.SolrResourceLoader Adding 'file:/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 1030507 INFO  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1030514 INFO  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1030529 INFO  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1030533 INFO  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1030607 INFO  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1030610 INFO  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1030611 INFO  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1030614 INFO  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1030615 INFO  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1030617 INFO  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1030617 WARN  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1030617 WARN  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1030617 INFO  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1030618 WARN  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1030618 WARN  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1030620 INFO  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1'
   [junit4]   2> 1030620 INFO  (coreLoadExecutor-4261-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1
   [junit4]   2> 1030620 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1030620 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[null]
   [junit4]   2> 1030620 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@53b22105
   [junit4]   2> 1030621 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/control/cores/collection1/data
   [junit4]   2> 1030621 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/control/cores/collection1/data/index/
   [junit4]   2> 1030621 WARN  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/control/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1030621 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/control/cores/collection1/data/index
   [junit4]   2> 1030621 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=25, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.11508873196107611]
   [junit4]   2> 1030621 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@52bf2ad3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7603bc02),segFN=segments_1,generation=1}
   [junit4]   2> 1030621 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1030622 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/control/cores/collection1/data/
   [junit4]   2> 1030622 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.DirectoryFactory /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/control/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1030624 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1030624 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1030624 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 1030624 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 1030624 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1030624 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1030625 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 1030625 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 1030625 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1030625 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1030625 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1030625 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1030626 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1030627 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1030629 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1030629 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1030632 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy 
   [junit4]   2> 1030633 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,spellCheckCompRH,lazy,/update/json/docs,/admin/luke,spellCheckWithWordbreak_Direct,tvrh,/get,/admin/properties,/update/json,mltrh,/admin/threads,/search-facet-def,/update/csv,/search-facet-invariants,/admin/segments,spellCheckCompRH1,/mlt,/admin/system,/replication,dismax,defaults,/config,/schema,/admin/plugins,/admin/logging,spellCheckWithWordbreak,mock,/admin/ping,/update,/admin/file,/terms,spellCheckCompRH_Direct,/debug/dump
   [junit4]   2> 1030634 WARN  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.c.SolrCore solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
   [junit4]   2> 1030634 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1030634 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1030634 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1030636 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 1030636 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 1030637 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6229983823975217]
   [junit4]   2> 1030637 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@52bf2ad3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7603bc02),segFN=segments_1,generation=1}
   [junit4]   2> 1030637 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1030637 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@27665600[collection1] main
   [junit4]   2> 1030637 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
   [junit4]   2> 1030637 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 1030637 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1030637 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 1030691 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 1030938 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1030938 INFO  (searcherExecutor-4262-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 1030939 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 1030939 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 1030939 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 1030939 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1519358747878621184
   [junit4]   2> 1030939 INFO  (searcherExecutor-4262-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 1030939 INFO  (searcherExecutor-4262-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 1030939 INFO  (searcherExecutor-4262-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 1030941 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1519358747878621184
   [junit4]   2> 1030941 INFO  (searcherExecutor-4262-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 1030941 INFO  (coreLoadExecutor-4261-thread-1) [    x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1030942 INFO  (searcherExecutor-4262-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 1030943 INFO  (searcherExecutor-4262-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 1030944 INFO  (searcherExecutor-4262-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 1030944 INFO  (searcherExecutor-4262-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 1030944 INFO  (searcherExecutor-4262-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@27665600[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1031176 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/shard0/cores/collection1
   [junit4]   2> 1031177 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 1031180 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@30176f7d{/,null,AVAILABLE}
   [junit4]   2> 1031181 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.e.j.s.ServerConnector Started ServerConnector@58594b17{HTTP/1.1,[http/1.1]}{127.0.0.1:38168}
   [junit4]   2> 1031181 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.e.j.s.Server Started @1035171ms
   [junit4]   2> 1031181 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=38168, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/shard0/cores}
   [junit4]   2> 1031181 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@659e0bfd
   [junit4]   2> 1031181 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/shard0'
   [junit4]   2> 1031181 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1031181 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1031182 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/shard0/solr.xml
   [junit4]   2> 1031187 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/shard0/cores
   [junit4]   2> 1031187 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.CoreContainer New CoreContainer 368177775
   [junit4]   2> 1031187 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/shard0]
   [junit4]   2> 1031187 WARN  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.CoreContainer Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/shard0/lib to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/shard0/lib
   [junit4]   2> 1031187 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1031188 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1031189 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1031189 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1031189 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1031189 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1031189 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.CoresLocator Looking for core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/shard0/cores
   [junit4]   2> 1031190 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/, configSet=collection1}
   [junit4]   2> 1031190 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.CoresLocator Found core collection1 in /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/shard0/cores/collection1
   [junit4]   2> 1031190 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 1031191 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.s.SolrDispatchFilter user.dir=/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0
   [junit4]   2> 1031191 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1031191 INFO  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1'
   [junit4]   2> 1031191 INFO  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1031191 INFO  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1031192 INFO  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.c.SolrResourceLoader Adding 'file:/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 1031192 INFO  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.c.SolrResourceLoader Adding 'file:/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 1031214 INFO  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1031221 INFO  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1031235 INFO  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1031238 INFO  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1031312 INFO  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1031316 INFO  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1031317 INFO  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1031320 INFO  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1031321 INFO  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1031322 INFO  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1031323 WARN  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1031323 WARN  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1031323 INFO  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1031323 WARN  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1031323 WARN  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1031324 INFO  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1'
   [junit4]   2> 1031325 INFO  (coreLoadExecutor-4272-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1
   [junit4]   2> 1031325 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1031325 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[null]
   [junit4]   2> 1031325 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@53b22105
   [junit4]   2> 1031325 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/shard0/cores/collection1/data
   [junit4]   2> 1031325 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/shard0/cores/collection1/data/index/
   [junit4]   2> 1031325 WARN  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/shard0/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1031325 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/shard0/cores/collection1/data/index
   [junit4]   2> 1031325 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=25, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.11508873196107611]
   [junit4]   2> 1031326 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@28c37753 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1eeb5904),segFN=segments_1,generation=1}
   [junit4]   2> 1031326 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1031326 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/shard0/cores/collection1/data/
   [junit4]   2> 1031327 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.DirectoryFactory /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/shard0/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1031329 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1031329 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1031329 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 1031329 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 1031329 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1031329 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1031329 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 1031329 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 1031329 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1031330 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1031330 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1031330 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1031331 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1031332 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1031333 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1031334 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1031337 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy 
   [junit4]   2> 1031340 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,spellCheckCompRH,lazy,/update/json/docs,/admin/luke,spellCheckWithWordbreak_Direct,tvrh,/get,/admin/properties,/update/json,mltrh,/admin/threads,/search-facet-def,/update/csv,/search-facet-invariants,/admin/segments,spellCheckCompRH1,/mlt,/admin/system,/replication,dismax,defaults,/config,/schema,/admin/plugins,/admin/logging,spellCheckWithWordbreak,mock,/admin/ping,/update,/admin/file,/terms,spellCheckCompRH_Direct,/debug/dump
   [junit4]   2> 1031340 WARN  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.c.SolrCore solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
   [junit4]   2> 1031340 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1031341 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1031341 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1031342 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 1031343 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 1031343 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6229983823975217]
   [junit4]   2> 1031344 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@28c37753 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1eeb5904),segFN=segments_1,generation=1}
   [junit4]   2> 1031344 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1031344 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@12cf2687[collection1] main
   [junit4]   2> 1031344 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
   [junit4]   2> 1031344 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 1031344 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1031344 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 1031396 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 1031638 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1031639 INFO  (searcherExecutor-4273-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 1031639 INFO  (searcherExecutor-4273-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 1031639 INFO  (searcherExecutor-4273-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 1031639 INFO  (searcherExecutor-4273-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 1031639 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 1031639 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 1031639 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 1031639 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1519358748612624384
   [junit4]   2> 1031640 INFO  (searcherExecutor-4273-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 1031640 INFO  (searcherExecutor-4273-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 1031641 INFO  (searcherExecutor-4273-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 1031641 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.u.UpdateLog Took 1.0ms to seed version buckets with highest version 1519358748612624384
   [junit4]   2> 1031641 INFO  (searcherExecutor-4273-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 1031641 INFO  (coreLoadExecutor-4272-thread-1) [    x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1031642 INFO  (searcherExecutor-4273-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 1031642 INFO  (searcherExecutor-4273-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@12cf2687[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1031693 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 1031699 INFO  (qtp1388899327-9316) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1519358748673441792)} 0 2
   [junit4]   2> 1031705 INFO  (qtp169800683-9334) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1519358748678684672)} 0 2
   [junit4]   2> 1031710 INFO  (qtp1388899327-9318) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1519358748683927552)]} 0 2
   [junit4]   2> 1031713 INFO  (qtp169800683-9335) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1519358748689170432)]} 0 1
   [junit4]   2> 1031717 INFO  (qtp1388899327-9317) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1519358748694413312)]} 0 0
   [junit4]   2> 1031721 INFO  (qtp169800683-9336) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1519358748697559040)]} 0 1
   [junit4]   2> 1031723 INFO  (qtp1388899327-9320) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1519358748700704768)]} 0 0
   [junit4]   2> 1031727 INFO  (qtp169800683-9337) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1519358748703850496)]} 0 0
   [junit4]   2> 1031729 INFO  (qtp1388899327-9321) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4 (1519358748706996224)]} 0 0
   [junit4]   2> 1031733 INFO  (qtp169800683-9338) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4 (1519358748709093376)]} 0 1
   [junit4]   2> 1031736 INFO  (qtp1388899327-9319) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5 (1519358748714336256)]} 0 0
   [junit4]   2> 1031739 INFO  (qtp169800683-9339) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5 (1519358748716433408)]} 0 0
   [junit4]   2> 1031741 INFO  (qtp1388899327-9314) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6 (1519358748718530560)]} 0 0
   [junit4]   2> 1031744 INFO  (qtp169800683-9332) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6 (1519358748721676288)]} 0 0
   [junit4]   2> 1031746 INFO  (qtp1388899327-9316) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7 (1519358748724822016)]} 0 0
   [junit4]   2> 1031748 INFO  (qtp169800683-9334) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7 (1519358748726919168)]} 0 0
   [junit4]   2> 1031752 INFO  (qtp1388899327-9318) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1519358748731113472)]} 0 0
   [junit4]   2> 1031754 INFO  (qtp169800683-9335) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1519358748733210624)]} 0 0
   [junit4]   2> 1031758 INFO  (qtp1388899327-9317) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9 (1519358748736356352)]} 0 0
   [junit4]   2> 1031761 INFO  (qtp169800683-9336) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9 (1519358748740550656)]} 0 0
   [junit4]   2> 1031763 INFO  (qtp1388899327-9320) [    x:collection1] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1031775 INFO  (qtp1388899327-9320) [    x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@52bf2ad3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7603bc02),segFN=segments_1,generation=1}
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@52bf2ad3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7603bc02),segFN=segments_2,generation=2}
   [junit4]   2> 1031777 INFO  (qtp1388899327-9320) [    x:collection1] o.a.s.c.SolrCore newest commit generation = 2
   [junit4]   2> 1031779 INFO  (qtp1388899327-9320) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@6e7224c4[collection1] main
   [junit4]   2> 1031779 INFO  (qtp1388899327-9320) [    x:collection1] o.a.s.u.UpdateHandler end_commit_flush
   [junit4]   2> 1031780 INFO  (searcherExecutor-4262-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6e7224c4[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C9)))}
   [junit4]   2> 1031780 INFO  (qtp1388899327-9320) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 17
   [junit4]   2> 1031783 INFO  (qtp169800683-9337) [    x:collection1] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1031786 INFO  (qtp169800683-9337) [    x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@28c37753 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1eeb5904),segFN=segments_1,generation=1}
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@28c37753 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1eeb5904),segFN=segments_2,generation=2}
   [junit4]   2> 1031787 INFO  (qtp169800683-9337) [    x:collection1] o.a.s.c.SolrCore newest commit generation = 2
   [junit4]   2> 1031788 INFO  (qtp169800683-9337) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@1d385a21[collection1] main
   [junit4]   2> 1031789 INFO  (qtp169800683-9337) [    x:collection1] o.a.s.u.UpdateHandler end_commit_flush
   [junit4]   2> 1031789 INFO  (searcherExecutor-4273-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1d385a21[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C9)))}
   [junit4]   2> 1031790 INFO  (qtp169800683-9337) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 7
   [junit4]   2> 1031796 INFO  (qtp1388899327-9321) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10 (1519358748774105088)]} 0 2
   [junit4]   2> 1031800 INFO  (qtp169800683-9338) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10 (1519358748779347968)]} 0 2
   [junit4]   2> 1031803 INFO  (qtp1388899327-9319) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11 (1519358748783542272)]} 0 0
   [junit4]   2> 1031807 INFO  (qtp169800683-9339) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11 (1519358748787736576)]} 0 0
   [junit4]   2> 1031811 INFO  (qtp1388899327-9314) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12 (1519358748792979456)]} 0 0
   [junit4]   2> 1031813 INFO  (qtp169800683-9332) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12 (1519358748795076608)]} 0 0
   [junit4]   2> 1031818 INFO  (qtp1388899327-9316) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13 (1519358748800319488)]} 0 0
   [junit4]   2> 1031824 INFO  (qtp169800683-9334) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13 (1519358748806610944)]} 0 0
   [junit4]   2> 1031829 INFO  (qtp1388899327-9318) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1001 (1519358748810805248)]} 0 1
   [junit4]   2> 1031833 INFO  (qtp169800683-9335) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1001 (1519358748816048128)]} 0 0
   [junit4]   2> 1031836 INFO  (qtp1388899327-9317) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14 (1519358748819193856)]} 0 0
   [junit4]   2> 1031839 INFO  (qtp169800683-9336) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14 (1519358748821291008)]} 0 0
   [junit4]   2> 1031842 INFO  (qtp1388899327-9320) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15 (1519358748824436736)]} 0 0
   [junit4]   2> 1031844 INFO  (qtp169800683-9337) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15 (1519358748827582464)]} 0 0
   [junit4]   2> 1031846 INFO  (qtp1388899327-9321) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16 (1519358748829679616)]} 0 0
   [junit4]   2> 1031848 INFO  (qtp169800683-9338) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16 (1519358748831776768)]} 0 0
   [junit4]   2> 1031851 INFO  (qtp1388899327-9319) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17 (1519358748833873920)]} 0 0
   [junit4]   2> 1031853 INFO  (qtp169800683-9339) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17 (1519358748837019648)]} 0 0
   [junit4]   2> 1031855 INFO  (qtp1388899327-9314) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[100 (1519358748839116800)]} 0 0
   [junit4]   2> 1031858 INFO  (qtp169800683-9332) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[100 (1519358748841213952)]} 0 0
   [junit4]   2> 1031862 INFO  (qtp1388899327-9316) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[101 (1519358748845408256)]} 0 0
   [junit4]   2> 1031864 INFO  (qtp169800683-9334) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[101 (1519358748847505408)]} 0 0
   [junit4]   2> 1031868 INFO  (qtp1388899327-9318) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[102 (1519358748852748288)]} 0 0
   [junit4]   2> 1031873 INFO  (qtp169800683-9335) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[102 (1519358748857991168)]} 0 0
   [junit4]   2> 1031878 INFO  (qtp1388899327-9317) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[103 (1519358748863234048)]} 0 0
   [junit4]   2> 1031880 INFO  (qtp169800683-9336) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[103 (1519358748865331200)]} 0 0
   [junit4]   2> 1031884 INFO  (qtp1388899327-9320) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[104 (1519358748869525504)]} 0 0
   [junit4]   2> 1031886 INFO  (qtp169800683-9337) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[104 (1519358748871622656)]} 0 0
   [junit4]   2> 1031888 INFO  (qtp1388899327-9321) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[105 (1519358748873719808)]} 0 0
   [junit4]   2> 1031891 INFO  (qtp169800683-9338) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[105 (1519358748875816960)]} 0 0
   [junit4]   2> 1031893 INFO  (qtp1388899327-9319) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[106 (1519358748877914112)]} 0 0
   [junit4]   2> 1031895 INFO  (qtp169800683-9339) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[106 (1519358748881059840)]} 0 0
   [junit4]   2> 1031898 INFO  (qtp1388899327-9314) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[107 (1519358748883156992)]} 0 0
   [junit4]   2> 1031902 INFO  (qtp169800683-9332) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[107 (1519358748887351296)]} 0 0
   [junit4]   2> 1031903 INFO  (qtp1388899327-9316) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[108 (1519358748889448448)]} 0 0
   [junit4]   2> 1031906 INFO  (qtp169800683-9334) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[108 (1519358748891545600)]} 0 0
   [junit4]   2> 1031908 INFO  (qtp1388899327-9318) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[109 (1519358748893642752)]} 0 0
   [junit4]   2> 1031911 INFO  (qtp169800683-9334) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[109 (1519358748897837056)]} 0 0
   [junit4]   2> 1031914 INFO  (qtp1388899327-9317) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[110 (1519358748900982784)]} 0 0
   [junit4]   2> 1031918 INFO  (qtp169800683-9336) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[110 (1519358748905177088)]} 0 0
   [junit4]   2> 1031920 INFO  (qtp1388899327-9320) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[111 (1519358748907274240)]} 0 0
   [junit4]   2> 1031924 INFO  (qtp169800683-9337) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[111 (1519358748910419968)]} 0 0
   [junit4]   2> 1031926 INFO  (qtp1388899327-9321) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[112 (1519358748912517120)]} 0 0
   [junit4]   2> 1031929 INFO  (qtp169800683-9338) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[112 (1519358748916711424)]} 0 0
   [junit4]   2> 1031931 INFO  (qtp1388899327-9321) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[113 (1519358748918808576)]} 0 0
   [junit4]   2> 1031934 INFO  (qtp169800683-9338) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[113 (1519358748921954304)]} 0 0
   [junit4]   2> 1031937 INFO  (qtp1388899327-9321) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[114 (1519358748925100032)]} 0 0
   [junit4]   2> 1031939 INFO  (qtp169800683-9332) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[114 (1519358748927197184)]} 0 0
   [junit4]   2> 1031942 INFO  (qtp1388899327-9316) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[115 (1519358748930342912)]} 0 0
   [junit4]   2> 1031944 INFO  (qtp169800683-9332) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[115 (1519358748931391488)]} 0 0
   [junit4]   2> 1031950 INFO  (qtp1388899327-9316) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[116 (1519358748937682944)]} 0 0
   [junit4]   2> 1031952 INFO  (qtp169800683-9334) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[116 (1519358748939780096)]} 0 0
   [junit4]   2> 1031954 INFO  (qtp1388899327-9317) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[117 (1519358748942925824)]} 0 0
   [junit4]   2> 1031956 INFO  (qtp169800683-9336) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[117 (1519358748945022976)]} 0 0
   [junit4]   2> 1031959 INFO  (qtp1388899327-9320) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[118 (1519358748948168704)]} 0 0
   [junit4]   2> 1031961 INFO  (qtp169800683-9337) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[118 (1519358748950265856)]} 0 0
   [junit4]   2> 1031963 INFO  (qtp1388899327-9319) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[119 (1519358748952363008)]} 0 0
   [junit4]   2> 1031966 INFO  (qtp169800683-9339) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[119 (1519358748954460160)]} 0 0
   [junit4]   2> 1031967 INFO  (qtp1388899327-9314) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[120 (1519358748956557312)]} 0 0
   [junit4]   2> 1031970 INFO  (qtp169800683-9338) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[120 (1519358748959703040)]} 0 0
   [junit4]   2> 1031973 INFO  (qtp1388899327-9321) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[121 (1519358748962848768)]} 0 0
   [junit4]   2> 1031979 INFO  (qtp169800683-9335) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[121 (1519358748969140224)]} 0 0
   [junit4]   2> 1031984 INFO  (qtp1388899327-9318) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[122 (1519358748974383104)]} 0 0
   [junit4]   2> 1031987 INFO  (qtp169800683-9332) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[122 (1519358748977528832)]} 0 0
   [junit4]   2> 1031989 INFO  (qtp1388899327-9316) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[123 (1519358748978577408)]} 0 0
   [junit4]   2> 1031994 INFO  (qtp169800683-9334) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[123 (1519358748983820288)]} 0 0
   [junit4]   2> 1031996 INFO  (qtp1388899327-9317) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[124 (1519358748986966016)]} 0 0
   [junit4]   2> 1031998 INFO  (qtp169800683-9336) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[124 (1519358748989063168)]} 0 0
   [junit4]   2> 1032000 INFO  (qtp1388899327-9320) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[125 (1519358748991160320)]} 0 0
   [junit4]   2> 1032003 INFO  (qtp169800683-9337) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[125 (1519358748994306048)]} 0 0
   [junit4]   2> 1032006 INFO  (qtp1388899327-9319) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[126 (1519358748997451776)]} 0 0
   [junit4]   2> 1032008 INFO  (qtp169800683-9339) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[126 (1519358748998500352)]} 0 0
   [junit4]   2> 1032010 INFO  (qtp1388899327-9314) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[127 (1519358749000597504)]} 0 0
   [junit4]   2> 1032012 INFO  (qtp169800683-9338) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[127 (1519358749002694656)]} 0 0
   [junit4]   2> 1032013 INFO  (qtp1388899327-9321) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[128 (1519358749004791808)]} 0 0
   [junit4]   2> 1032015 INFO  (qtp169800683-9335) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[128 (1519358749006888960)]} 0 0
   [junit4]   2> 1032018 INFO  (qtp1388899327-9318) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[129 (1519358749010034688)]} 0 0
   [junit4]   2> 1032021 INFO  (qtp169800683-9332) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[129 (1519358749013180416)]} 0 0
   [junit4]   2> 1032023 INFO  (qtp1388899327-9316) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[130 (1519358749015277568)]} 0 0
   [junit4]   2> 1032025 INFO  (qtp169800683-9334) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[130 (1519358749017374720)]} 0 0
   [junit4]   2> 1032029 INFO  (qtp1388899327-9317) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[131 (1519358749020520448)]} 0 0
   [junit4]   2> 1032030 INFO  (qtp169800683-9336) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[131 (1519358749022617600)]} 0 0
   [junit4]   2> 1032033 INFO  (qtp1388899327-9320) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[132 (1519358749025763328)]} 0 0
   [junit4]   2> 1032035 INFO  (qtp169800683-9337) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[132 (1519358749027860480)]} 0 0
   [junit4]   2> 1032037 INFO  (qtp1388899327-9319) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[133 (1519358749028909056)]} 0 0
   [junit4]   2> 1032039 INFO  (qtp169800683-9339) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[133 (1519358749032054784)]} 0 0
   [junit4]   2> 1032044 INFO  (qtp1388899327-9314) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[134 (1519358749037297664)]} 0 0
   [junit4]   2> 1032055 INFO  (qtp169800683-9338) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[134 (1519358749047783424)]} 0 0
   [junit4]   2> 1032058 INFO  (qtp1388899327-9321) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[135 (1519358749050929152)]} 0 0
   [junit4]   2> 1032062 INFO  (qtp169800683-9335) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[135 (1519358749056172032)]} 0 0
   [junit4]   2> 1032064 INFO  (qtp1388899327-9318) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[136 (1519358749058269184)]} 0 0
   [junit4]   2> 1032066 INFO  (qtp169800683-9332) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[136 (1519358749060366336)]} 0 0
   [junit4]   2> 1032069 INFO  (qtp1388899327-9316) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[137 (1519358749063512064)]} 0 0
   [junit4]   2> 1032074 INFO  (qtp169800683-9334) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[137 (1519358749068754944)]} 0 0
   [junit4]   2> 1032076 INFO  (qtp1388899327-9317) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[138 (1519358749070852096)]} 0 0
   [junit4]   2> 1032078 INFO  (qtp169800683-9336) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[138 (1519358749072949248)]} 0 0
   [junit4]   2> 1032081 INFO  (qtp1388899327-9320) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[139 (1519358749076094976)]} 0 1
   [junit4]   2> 1032084 INFO  (qtp169800683-9337) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[139 (1519358749079240704)]} 0 0
   [junit4]   2> 1032086 INFO  (qtp1388899327-9319) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[140 (1519358749081337856)]} 0 0
   [junit4]   2> 1032089 INFO  (qtp169800683-9339) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[140 (1519358749084483584)]} 0 0
   [junit4]   2> 1032091 INFO  (qtp1388899327-9314) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[141 (1519358749086580736)]} 0 0
   [junit4]   2> 1032095 INFO  (qtp169800683-9338) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[141 (1519358749090775040)]} 0 0
   [junit4]   2> 1032098 INFO  (qtp1388899327-9321) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[142 (1519358749093920768)]} 0 0
   [junit4]   2> 1032104 INFO  (qtp169800683-9335) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[142 (1519358749100212224)]} 0 0
   [junit4]   2> 1032107 INFO  (qtp1388899327-9318) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[143 (1519358749103357952)]} 0 0
   [junit4]   2> 1032109 INFO  (qtp169800683-9332) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[143 (1519358749105455104)]} 0 0
   [junit4]   2> 1032112 INFO  (qtp1388899327-9316) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[144 (1519358749108600832)]} 0 0
   [junit4]   2> 1032114 INFO  (qtp169800683-9334) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[144 (1519358749110697984)]} 0 0
   [junit4]   2> 1032116 INFO  (qtp1388899327-9317) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[145 (1519358749112795136)]} 0 0
   [junit4]   2> 1032119 INFO  (qtp169800683-9336) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[145 (1519358749115940864)]} 0 0
   [junit4]   2> 1032124 INFO  (qtp1388899327-9320) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[146 (1519358749121183744)]} 0 0
   [junit4]   2> 1032130 INFO  (qtp169800683-9337) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[146 (1519358749127475200)]} 0 0
   [junit4]   2> 1032134 INFO  (qtp1388899327-9319) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[147 (1519358749131669504)]} 0 0
   [junit4]   2> 1032137 INFO  (qtp169800683-9339) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[147 (1519358749133766656)]} 0 0
   [junit4]   2> 1032140 INFO  (qtp1388899327-9314) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[148 (1519358749137960960)]} 0 0
   [junit4]   2> 1032142 INFO  (qtp169800683-9338) [    x:collection1] o.a.s.u.p.LogUpdateProcessor [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[148 (1519358749140058112)]} 0 0

[...truncated too long message...]

4]   2> 1137048 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001/tempDir-001/shard1/cores/collection1/data
   [junit4]   2> 1137050 INFO  (TEST-TestDistributedSearch.test-seed#[4DC776BC2100EAA6]) [    x:collection1] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3a21ad63{/,null,UNAVAILABLE}
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestDistributedSearch -Dtests.method=test -Dtests.seed=4DC776BC2100EAA6 -Dtests.slow=true -Dtests.locale=de_CH -Dtests.timezone=Atlantic/Stanley -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR    107s J0 | TestDistributedSearch.test <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:45240//collection1: java.lang.NullPointerException
   [junit4]    > 	at org.apache.solr.search.grouping.distributed.responseprocessor.TopGroupsShardResponseProcessor.process(TopGroupsShardResponseProcessor.java:105)
   [junit4]    > 	at org.apache.solr.handler.component.QueryComponent.handleGroupedResponses(QueryComponent.java:744)
   [junit4]    > 	at org.apache.solr.handler.component.QueryComponent.handleResponses(QueryComponent.java:727)
   [junit4]    > 	at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:409)
   [junit4]    > 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:151)
   [junit4]    > 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2069)
   [junit4]    > 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:654)
   [junit4]    > 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:455)
   [junit4]    > 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:221)
   [junit4]    > 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:180)
   [junit4]    > 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
   [junit4]    > 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:109)
   [junit4]    > 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
   [junit4]    > 	at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:45)
   [junit4]    > 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
   [junit4]    > 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)
   [junit4]    > 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]    > 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1158)
   [junit4]    > 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)
   [junit4]    > 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]    > 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1090)
   [junit4]    > 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]    > 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)
   [junit4]    > 	at org.eclipse.jetty.server.Server.handle(Server.java:517)
   [junit4]    > 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:308)
   [junit4]    > 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:242)
   [junit4]    > 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:261)
   [junit4]    > 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
   [junit4]    > 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:75)
   [junit4]    > 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:213)
   [junit4]    > 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:147)
   [junit4]    > 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
   [junit4]    > 	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([4DC776BC2100EAA6:C59349668FFC875E]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:574)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:240)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:229)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
   [junit4]    > 	at org.apache.solr.TestDistributedSearch.queryRandomUpServer(TestDistributedSearch.java:1133)
   [junit4]    > 	at org.apache.solr.TestDistributedSearch.queryPartialResults(TestDistributedSearch.java:1095)
   [junit4]    > 	at org.apache.solr.TestDistributedSearch.test(TestDistributedSearch.java:968)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:986)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:939)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1137093 INFO  (SUITE-TestDistributedSearch-seed#[4DC776BC2100EAA6]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_4DC776BC2100EAA6-001
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=de_CH, timezone=Atlantic/Stanley
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=3,threads=1,free=268931872,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestReplicationHandlerBackup, TestRemoveLastDynamicCopyField, SoftAutoCommitTest, SystemInfoHandlerTest, TestFieldTypeResource, HdfsLockFactoryTest, InfoHandlerTest, TestDFRSimilarityFactory, TestQuerySenderNoQuery, DocumentBuilderTest, TestConfigOverlay, UnloadDistributedZkTest, TestSimpleTrackingShardHandler, ConcurrentDeleteAndCreateCollectionTest, ZkCLITest, TestSolrConfigHandlerCloud, SliceStateTest, BasicAuthIntegrationTest, IndexBasedSpellCheckerTest, CdcrReplicationHandlerTest, TestNamedUpdateProcessors, DirectUpdateHandlerTest, HdfsSyncSliceTest, TestWordDelimiterFilterFactory, TestDownShardTolerantSearch, TestSimpleQParserPlugin, MultiThreadedOCPTest, JSONWriterTest, CircularListTest, BasicDistributedZkTest, TermsComponentTest, TestCustomSort, TestSolrDeletionPolicy1, SpatialRPTFieldTypeTest, SimpleFacetsTest, TestDocBasedVersionConstraints, AddBlockUpdateTest, PathHierarchyTokenizerFactoryTest, TestElisionMultitermQuery, TestCustomDocTransformer, LeaderElectionTest, PrimUtilsTest, TestSerializedLuceneMatchVersion, CollectionStateFormat2Test, IndexSchemaTest, CurrencyFieldXmlFileTest, ZkControllerTest, TestSurroundQueryParser, TestSolrQueryParserDefaultOperatorResource, TestMergePolicyConfig, DistributedFacetPivotLongTailTest, ClusterStateUpdateTest, FastVectorHighlighterTest, TestManagedSchemaFieldResource, SimpleCollectionCreateDeleteTest, TestSweetSpotSimilarityFactory, SyncSliceTest, TestCloudSchemaless, TestRandomMergePolicy, TestFunctionQuery, TestCopyFieldCollectionResource, XmlUpdateRequestHandlerTest, CleanupOldIndexTest, ZkStateReaderTest, TestPhraseSuggestions, TestOverriddenPrefixQueryForCustomFieldType, TestBulkSchemaAPI, TestXIncludeConfig, TestGroupingSearch, TestDistributedMissingSort, TestDocumentBuilder, TestExpandComponent, SpatialHeatmapFacetsTest, TestPseudoReturnFields, SimplePostToolTest, TestReplicationHandler, TestLazyCores, TestPostingsSolrHighlighter, ActionThrottleTest, SOLR749Test, TestSolrCloudWithKerberosAlt, BigEndianAscendingWordDeserializerTest, TestDistributedSearch]
   [junit4] Completed [176/563] on J0 in 106.82s, 1 test, 1 error <<< FAILURES!

[...truncated 1269 lines...]
BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/build.xml:775: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/build.xml:719: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/build.xml:59: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build.xml:233: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/common-build.xml:516: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/lucene/common-build.xml:1432: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/lucene/common-build.xml:987: There were test failures: 563 suites (8 ignored), 2234 tests, 1 error, 83 ignored (68 assumptions) [seed: 4DC776BC2100EAA6]

Total time: 71 minutes 45 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-trunk-Solaris (64bit/jdk1.8.0) - Build # 227 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Solaris/227/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

2 tests failed.
FAILED:  org.apache.lucene.replicator.http.HttpReplicatorTest.testBasic

Error Message:
127.0.0.1:44865 failed to respond

Stack Trace:
org.apache.http.NoHttpResponseException: 127.0.0.1:44865 failed to respond
	at __randomizedtesting.SeedInfo.seed([4EE3FEA531BBACFC:E519E3B0EE672AD2]:0)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:167)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.lucene.replicator.http.HttpClientBase.executeGET(HttpClientBase.java:159)
	at org.apache.lucene.replicator.http.HttpReplicator.checkForUpdate(HttpReplicator.java:51)
	at org.apache.lucene.replicator.ReplicationClient.doUpdate(ReplicationClient.java:196)
	at org.apache.lucene.replicator.ReplicationClient.updateNow(ReplicationClient.java:402)
	at org.apache.lucene.replicator.http.HttpReplicatorTest.testBasic(HttpReplicatorTest.java:122)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.lucene.replicator.http.HttpReplicatorTest.testServerErrors

Error Message:
127.0.0.1:50925 failed to respond

Stack Trace:
org.apache.http.NoHttpResponseException: 127.0.0.1:50925 failed to respond
	at __randomizedtesting.SeedInfo.seed([4EE3FEA531BBACFC:5988511AA53B2E6E]:0)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.lucene.replicator.http.HttpClientBase.executeGET(HttpClientBase.java:159)
	at org.apache.lucene.replicator.http.HttpReplicator.checkForUpdate(HttpReplicator.java:51)
	at org.apache.lucene.replicator.ReplicationClient.doUpdate(ReplicationClient.java:196)
	at org.apache.lucene.replicator.ReplicationClient.updateNow(ReplicationClient.java:402)
	at org.apache.lucene.replicator.http.HttpReplicatorTest.testServerErrors(HttpReplicatorTest.java:155)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 7356 lines...]
   [junit4] Suite: org.apache.lucene.replicator.http.HttpReplicatorTest
   [junit4]   2> 2015-12-02 06:48:02.887:INFO::TEST-HttpReplicatorTest.testBasic-seed#[4EE3FEA531BBACFC]: Logging initialized @6352ms
   [junit4]   2> 2015-12-02 06:48:03.037:INFO:oejs.Server:TEST-HttpReplicatorTest.testBasic-seed#[4EE3FEA531BBACFC]: jetty-9.3.6.v20151106
   [junit4]   2> 2015-12-02 06:48:03.108:INFO:oejs.ServerConnector:TEST-HttpReplicatorTest.testBasic-seed#[4EE3FEA531BBACFC]: Started ServerConnector@26087a61{HTTP/1.1,[http/1.1]}{127.0.0.1:44865}
   [junit4]   2> 2015-12-02 06:48:03.108:INFO:oejs.Server:TEST-HttpReplicatorTest.testBasic-seed#[4EE3FEA531BBACFC]: Started @6574ms
   [junit4]   2> Ara 02, 2015 6:48:03 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://127.0.0.1:44865: The target server failed to respond
   [junit4]   2> Ara 02, 2015 6:48:03 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: Retrying request to {}->http://127.0.0.1:44865
   [junit4]   2> Ara 02, 2015 6:48:03 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://127.0.0.1:44865: The target server failed to respond
   [junit4]   2> Ara 02, 2015 6:48:03 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: Retrying request to {}->http://127.0.0.1:44865
   [junit4]   2> Ara 02, 2015 6:48:03 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://127.0.0.1:44865: The target server failed to respond
   [junit4]   2> Ara 02, 2015 6:48:03 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: Retrying request to {}->http://127.0.0.1:44865
   [junit4]   2> 2015-12-02 06:48:03.888:INFO:oejs.ServerConnector:TEST-HttpReplicatorTest.testBasic-seed#[4EE3FEA531BBACFC]: Stopped ServerConnector@26087a61{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HttpReplicatorTest -Dtests.method=testBasic -Dtests.seed=4EE3FEA531BBACFC -Dtests.slow=true -Dtests.locale=tr_TR -Dtests.timezone=Europe/Oslo -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   1.06s J1 | HttpReplicatorTest.testBasic <<<
   [junit4]    > Throwable #1: org.apache.http.NoHttpResponseException: 127.0.0.1:44865 failed to respond
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([4EE3FEA531BBACFC:E519E3B0EE672AD2]:0)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
   [junit4]    > 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
   [junit4]    > 	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
   [junit4]    > 	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:167)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
   [junit4]    > 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
   [junit4]    > 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
   [junit4]    > 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
   [junit4]    > 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
   [junit4]    > 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
   [junit4]    > 	at org.apache.lucene.replicator.http.HttpClientBase.executeGET(HttpClientBase.java:159)
   [junit4]    > 	at org.apache.lucene.replicator.http.HttpReplicator.checkForUpdate(HttpReplicator.java:51)
   [junit4]    > 	at org.apache.lucene.replicator.ReplicationClient.doUpdate(ReplicationClient.java:196)
   [junit4]    > 	at org.apache.lucene.replicator.ReplicationClient.updateNow(ReplicationClient.java:402)
   [junit4]    > 	at org.apache.lucene.replicator.http.HttpReplicatorTest.testBasic(HttpReplicatorTest.java:122)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 2015-12-02 06:48:03.902:INFO:oejs.Server:TEST-HttpReplicatorTest.testServerErrors-seed#[4EE3FEA531BBACFC]: jetty-9.3.6.v20151106
   [junit4]   2> 2015-12-02 06:48:03.903:INFO:oejs.ServerConnector:TEST-HttpReplicatorTest.testServerErrors-seed#[4EE3FEA531BBACFC]: Started ServerConnector@73fdd192{HTTP/1.1,[http/1.1]}{127.0.0.1:50925}
   [junit4]   2> 2015-12-02 06:48:03.903:INFO:oejs.Server:TEST-HttpReplicatorTest.testServerErrors-seed#[4EE3FEA531BBACFC]: Started @7369ms
   [junit4]   2> Ara 02, 2015 6:48:03 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://127.0.0.1:50925: The target server failed to respond
   [junit4]   2> Ara 02, 2015 6:48:03 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: Retrying request to {}->http://127.0.0.1:50925
   [junit4]   2> Ara 02, 2015 6:48:03 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://127.0.0.1:50925: The target server failed to respond
   [junit4]   2> Ara 02, 2015 6:48:03 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: Retrying request to {}->http://127.0.0.1:50925
   [junit4]   2> Ara 02, 2015 6:48:03 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://127.0.0.1:50925: The target server failed to respond
   [junit4]   2> Ara 02, 2015 6:48:03 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: Retrying request to {}->http://127.0.0.1:50925
   [junit4]   2> Ara 02, 2015 6:48:03 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://127.0.0.1:50925: The target server failed to respond
   [junit4]   2> Ara 02, 2015 6:48:03 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: Retrying request to {}->http://127.0.0.1:50925
   [junit4]   2> Ara 02, 2015 6:48:03 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://127.0.0.1:50925: The target server failed to respond
   [junit4]   2> Ara 02, 2015 6:48:03 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: Retrying request to {}->http://127.0.0.1:50925
   [junit4]   2> Ara 02, 2015 6:48:03 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://127.0.0.1:50925: The target server failed to respond
   [junit4]   2> Ara 02, 2015 6:48:03 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: Retrying request to {}->http://127.0.0.1:50925
   [junit4]   2> 2015-12-02 06:48:03.939:INFO:oejs.ServerConnector:TEST-HttpReplicatorTest.testServerErrors-seed#[4EE3FEA531BBACFC]: Stopped ServerConnector@73fdd192{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HttpReplicatorTest -Dtests.method=testServerErrors -Dtests.seed=4EE3FEA531BBACFC -Dtests.slow=true -Dtests.locale=tr_TR -Dtests.timezone=Europe/Oslo -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.04s J1 | HttpReplicatorTest.testServerErrors <<<
   [junit4]    > Throwable #1: org.apache.http.NoHttpResponseException: 127.0.0.1:50925 failed to respond
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([4EE3FEA531BBACFC:5988511AA53B2E6E]:0)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
   [junit4]    > 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
   [junit4]    > 	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
   [junit4]    > 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
   [junit4]    > 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
   [junit4]    > 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
   [junit4]    > 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
   [junit4]    > 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
   [junit4]    > 	at org.apache.lucene.replicator.http.HttpClientBase.executeGET(HttpClientBase.java:159)
   [junit4]    > 	at org.apache.lucene.replicator.http.HttpReplicator.checkForUpdate(HttpReplicator.java:51)
   [junit4]    > 	at org.apache.lucene.replicator.ReplicationClient.doUpdate(ReplicationClient.java:196)
   [junit4]    > 	at org.apache.lucene.replicator.ReplicationClient.updateNow(ReplicationClient.java:402)
   [junit4]    > 	at org.apache.lucene.replicator.http.HttpReplicatorTest.testServerErrors(HttpReplicatorTest.java:155)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/lucene/build/replicator/test/J1/temp/lucene.replicator.http.HttpReplicatorTest_4EE3FEA531BBACFC-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, sim=ClassicSimilarity, locale=tr_TR, timezone=Europe/Oslo
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=3,threads=1,free=46958320,total=64880640
   [junit4]   2> NOTE: All tests run in this JVM: [LocalReplicatorTest, IndexAndTaxonomyRevisionTest, IndexReplicationClientTest, HttpReplicatorTest]
   [junit4] Completed [7/7] on J1 in 1.13s, 2 tests, 2 errors <<< FAILURES!

[...truncated 11 lines...]
BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/build.xml:775: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/build.xml:719: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/build.xml:59: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/lucene/build.xml:471: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/lucene/common-build.xml:2162: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/lucene/module-build.xml:58: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/lucene/common-build.xml:1432: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/lucene/common-build.xml:987: There were test failures: 7 suites, 31 tests, 2 errors [seed: 4EE3FEA531BBACFC]

Total time: 17 minutes 13 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-trunk-Solaris (64bit/jdk1.8.0) - Build # 226 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Solaris/226/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

2 tests failed.
FAILED:  org.apache.lucene.replicator.http.HttpReplicatorTest.testServerErrors

Error Message:
127.0.0.1:51030 failed to respond

Stack Trace:
org.apache.http.NoHttpResponseException: 127.0.0.1:51030 failed to respond
	at __randomizedtesting.SeedInfo.seed([968B70808A73F373:81E0DF3F1EF371E1]:0)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.lucene.replicator.http.HttpClientBase.executeGET(HttpClientBase.java:159)
	at org.apache.lucene.replicator.http.HttpReplicator.checkForUpdate(HttpReplicator.java:51)
	at org.apache.lucene.replicator.ReplicationClient.doUpdate(ReplicationClient.java:196)
	at org.apache.lucene.replicator.ReplicationClient.updateNow(ReplicationClient.java:402)
	at org.apache.lucene.replicator.http.HttpReplicatorTest.testServerErrors(HttpReplicatorTest.java:155)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.lucene.replicator.http.HttpReplicatorTest.testBasic

Error Message:
127.0.0.1:33810 failed to respond

Stack Trace:
org.apache.http.NoHttpResponseException: 127.0.0.1:33810 failed to respond
	at __randomizedtesting.SeedInfo.seed([968B70808A73F373:3D716D9555AF755D]:0)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:167)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.lucene.replicator.http.HttpClientBase.executeGET(HttpClientBase.java:159)
	at org.apache.lucene.replicator.http.HttpReplicator.checkForUpdate(HttpReplicator.java:51)
	at org.apache.lucene.replicator.ReplicationClient.doUpdate(ReplicationClient.java:196)
	at org.apache.lucene.replicator.ReplicationClient.updateNow(ReplicationClient.java:402)
	at org.apache.lucene.replicator.http.HttpReplicatorTest.testBasic(HttpReplicatorTest.java:122)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 7503 lines...]
   [junit4] Suite: org.apache.lucene.replicator.http.HttpReplicatorTest
   [junit4]   2> 2015-12-02 07:18:07.697:INFO::TEST-HttpReplicatorTest.testServerErrors-seed#[968B70808A73F373]: Logging initialized @2043ms
   [junit4]   2> 2015-12-02 07:18:07.825:INFO:oejs.Server:TEST-HttpReplicatorTest.testServerErrors-seed#[968B70808A73F373]: jetty-9.3.6.v20151106
   [junit4]   2> 2015-12-02 07:18:07.966:INFO:oejs.ServerConnector:TEST-HttpReplicatorTest.testServerErrors-seed#[968B70808A73F373]: Started ServerConnector@5702b8cf{HTTP/1.1,[http/1.1]}{127.0.0.1:51030}
   [junit4]   2> 2015-12-02 07:18:07.970:INFO:oejs.Server:TEST-HttpReplicatorTest.testServerErrors-seed#[968B70808A73F373]: Started @2316ms
   [junit4]   2> Ara 02, 2015 7:18:09 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://127.0.0.1:51030: The target server failed to respond
   [junit4]   2> Ara 02, 2015 7:18:09 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: Retrying request to {}->http://127.0.0.1:51030
   [junit4]   2> Ara 02, 2015 7:18:09 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://127.0.0.1:51030: The target server failed to respond
   [junit4]   2> Ara 02, 2015 7:18:09 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: Retrying request to {}->http://127.0.0.1:51030
   [junit4]   2> Ara 02, 2015 7:18:09 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: I/O exception (java.net.SocketException) caught when processing request to {}->http://127.0.0.1:51030: Connection reset
   [junit4]   2> Ara 02, 2015 7:18:09 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: Retrying request to {}->http://127.0.0.1:51030
   [junit4]   2> Ara 02, 2015 7:18:09 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://127.0.0.1:51030: The target server failed to respond
   [junit4]   2> Ara 02, 2015 7:18:09 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: Retrying request to {}->http://127.0.0.1:51030
   [junit4]   2> Ara 02, 2015 7:18:09 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://127.0.0.1:51030: The target server failed to respond
   [junit4]   2> Ara 02, 2015 7:18:09 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: Retrying request to {}->http://127.0.0.1:51030
   [junit4]   2> Ara 02, 2015 7:18:09 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://127.0.0.1:51030: The target server failed to respond
   [junit4]   2> Ara 02, 2015 7:18:09 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: Retrying request to {}->http://127.0.0.1:51030
   [junit4]   2> 2015-12-02 07:18:09.671:INFO:oejs.ServerConnector:TEST-HttpReplicatorTest.testServerErrors-seed#[968B70808A73F373]: Stopped ServerConnector@5702b8cf{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HttpReplicatorTest -Dtests.method=testServerErrors -Dtests.seed=968B70808A73F373 -Dtests.slow=true -Dtests.locale=tr -Dtests.timezone=Australia/Yancowinna -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   2.17s J0 | HttpReplicatorTest.testServerErrors <<<
   [junit4]    > Throwable #1: org.apache.http.NoHttpResponseException: 127.0.0.1:51030 failed to respond
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([968B70808A73F373:81E0DF3F1EF371E1]:0)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
   [junit4]    > 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
   [junit4]    > 	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
   [junit4]    > 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
   [junit4]    > 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
   [junit4]    > 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
   [junit4]    > 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
   [junit4]    > 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
   [junit4]    > 	at org.apache.lucene.replicator.http.HttpClientBase.executeGET(HttpClientBase.java:159)
   [junit4]    > 	at org.apache.lucene.replicator.http.HttpReplicator.checkForUpdate(HttpReplicator.java:51)
   [junit4]    > 	at org.apache.lucene.replicator.ReplicationClient.doUpdate(ReplicationClient.java:196)
   [junit4]    > 	at org.apache.lucene.replicator.ReplicationClient.updateNow(ReplicationClient.java:402)
   [junit4]    > 	at org.apache.lucene.replicator.http.HttpReplicatorTest.testServerErrors(HttpReplicatorTest.java:155)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 2015-12-02 07:18:09.733:INFO:oejs.Server:TEST-HttpReplicatorTest.testBasic-seed#[968B70808A73F373]: jetty-9.3.6.v20151106
   [junit4]   2> 2015-12-02 07:18:09.735:INFO:oejs.ServerConnector:TEST-HttpReplicatorTest.testBasic-seed#[968B70808A73F373]: Started ServerConnector@5e0862e9{HTTP/1.1,[http/1.1]}{127.0.0.1:33810}
   [junit4]   2> 2015-12-02 07:18:09.735:INFO:oejs.Server:TEST-HttpReplicatorTest.testBasic-seed#[968B70808A73F373]: Started @4082ms
   [junit4]   2> Ara 02, 2015 7:18:09 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://127.0.0.1:33810: The target server failed to respond
   [junit4]   2> Ara 02, 2015 7:18:09 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: Retrying request to {}->http://127.0.0.1:33810
   [junit4]   2> Ara 02, 2015 7:18:09 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://127.0.0.1:33810: The target server failed to respond
   [junit4]   2> Ara 02, 2015 7:18:09 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: Retrying request to {}->http://127.0.0.1:33810
   [junit4]   2> Ara 02, 2015 7:18:09 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://127.0.0.1:33810: The target server failed to respond
   [junit4]   2> Ara 02, 2015 7:18:09 AM org.apache.http.impl.execchain.RetryExec execute
   [junit4]   2> INFO: Retrying request to {}->http://127.0.0.1:33810
   [junit4]   2> 2015-12-02 07:18:09.798:INFO:oejs.ServerConnector:TEST-HttpReplicatorTest.testBasic-seed#[968B70808A73F373]: Stopped ServerConnector@5e0862e9{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HttpReplicatorTest -Dtests.method=testBasic -Dtests.seed=968B70808A73F373 -Dtests.slow=true -Dtests.locale=tr -Dtests.timezone=Australia/Yancowinna -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.09s J0 | HttpReplicatorTest.testBasic <<<
   [junit4]    > Throwable #1: org.apache.http.NoHttpResponseException: 127.0.0.1:33810 failed to respond
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([968B70808A73F373:3D716D9555AF755D]:0)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
   [junit4]    > 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
   [junit4]    > 	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
   [junit4]    > 	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:167)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
   [junit4]    > 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
   [junit4]    > 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
   [junit4]    > 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
   [junit4]    > 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
   [junit4]    > 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
   [junit4]    > 	at org.apache.lucene.replicator.http.HttpClientBase.executeGET(HttpClientBase.java:159)
   [junit4]    > 	at org.apache.lucene.replicator.http.HttpReplicator.checkForUpdate(HttpReplicator.java:51)
   [junit4]    > 	at org.apache.lucene.replicator.ReplicationClient.doUpdate(ReplicationClient.java:196)
   [junit4]    > 	at org.apache.lucene.replicator.ReplicationClient.updateNow(ReplicationClient.java:402)
   [junit4]    > 	at org.apache.lucene.replicator.http.HttpReplicatorTest.testBasic(HttpReplicatorTest.java:122)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/lucene/build/replicator/test/J0/temp/lucene.replicator.http.HttpReplicatorTest_968B70808A73F373-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=tr, timezone=Australia/Yancowinna
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=3,threads=1,free=34757336,total=64880640
   [junit4]   2> NOTE: All tests run in this JVM: [HttpReplicatorTest]
   [junit4] Completed [2/7] on J0 in 2.74s, 2 tests, 2 errors <<< FAILURES!

[...truncated 26 lines...]
BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/build.xml:775: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/build.xml:719: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/build.xml:59: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/lucene/build.xml:471: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/lucene/common-build.xml:2162: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/lucene/module-build.xml:58: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/lucene/common-build.xml:1432: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/lucene/common-build.xml:987: There were test failures: 7 suites, 31 tests, 2 errors [seed: 968B70808A73F373]

Total time: 19 minutes 32 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any