You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2015/04/15 23:32:17 UTC
[JENKINS] Lucene-Solr-Tests-5.x-Java7 - Build # 2953 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.x-Java7/2953/
4 tests failed.
REGRESSION: org.apache.solr.cloud.AsyncMigrateRouteKeyTest.test
Error Message:
There are still nodes recoverying - waited for 15 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 15 seconds
at __randomizedtesting.SeedInfo.seed([79D1DF19120705EE:F185E0C3BCFB6816]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:172)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:883)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForThingsToLevelOut(AbstractFullDistribZkTestBase.java:1440)
at org.apache.solr.cloud.AsyncMigrateRouteKeyTest.test(AsyncMigrateRouteKeyTest.java:41)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.AsyncMigrateRouteKeyTest
Error Message:
ERROR: SolrIndexSearcher opens=5 closes=4
Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=5 closes=4
at __randomizedtesting.SeedInfo.seed([79D1DF19120705EE]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:496)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:232)
at sun.reflect.GeneratedMethodAccessor37.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.AsyncMigrateRouteKeyTest
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.AsyncMigrateRouteKeyTest: 1) Thread[id=8411, name=searcherExecutor-2792-thread-1, state=WAITING, group=TGRP-AsyncMigrateRouteKeyTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=8397, name=qtp405453587-8397, state=RUNNABLE, group=TGRP-AsyncMigrateRouteKeyTest] at java.util.WeakHashMap.get(WeakHashMap.java:471) at org.apache.solr.servlet.cache.HttpCacheHeaderUtil.calcEtag(HttpCacheHeaderUtil.java:101) at org.apache.solr.servlet.cache.HttpCacheHeaderUtil.doCacheHeaderValidation(HttpCacheHeaderUtil.java:219) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:444) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:223) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:104) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:368) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235) at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.AsyncMigrateRouteKeyTest:
1) Thread[id=8411, name=searcherExecutor-2792-thread-1, state=WAITING, group=TGRP-AsyncMigrateRouteKeyTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2) Thread[id=8397, name=qtp405453587-8397, state=RUNNABLE, group=TGRP-AsyncMigrateRouteKeyTest]
at java.util.WeakHashMap.get(WeakHashMap.java:471)
at org.apache.solr.servlet.cache.HttpCacheHeaderUtil.calcEtag(HttpCacheHeaderUtil.java:101)
at org.apache.solr.servlet.cache.HttpCacheHeaderUtil.doCacheHeaderValidation(HttpCacheHeaderUtil.java:219)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:444)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:223)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:104)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
at org.eclipse.jetty.server.Server.handle(Server.java:368)
at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([79D1DF19120705EE]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.AsyncMigrateRouteKeyTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=8411, name=searcherExecutor-2792-thread-1, state=WAITING, group=TGRP-AsyncMigrateRouteKeyTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=8397, name=qtp405453587-8397, state=RUNNABLE, group=TGRP-AsyncMigrateRouteKeyTest] at java.util.WeakHashMap.get(WeakHashMap.java:471) at org.apache.solr.servlet.cache.HttpCacheHeaderUtil.calcEtag(HttpCacheHeaderUtil.java:101) at org.apache.solr.servlet.cache.HttpCacheHeaderUtil.doCacheHeaderValidation(HttpCacheHeaderUtil.java:219) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:444) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:223) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:104) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:368) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235) at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=8411, name=searcherExecutor-2792-thread-1, state=WAITING, group=TGRP-AsyncMigrateRouteKeyTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2) Thread[id=8397, name=qtp405453587-8397, state=RUNNABLE, group=TGRP-AsyncMigrateRouteKeyTest]
at java.util.WeakHashMap.get(WeakHashMap.java:471)
at org.apache.solr.servlet.cache.HttpCacheHeaderUtil.calcEtag(HttpCacheHeaderUtil.java:101)
at org.apache.solr.servlet.cache.HttpCacheHeaderUtil.doCacheHeaderValidation(HttpCacheHeaderUtil.java:219)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:444)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:223)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:104)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
at org.eclipse.jetty.server.Server.handle(Server.java:368)
at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([79D1DF19120705EE]:0)
Build Log:
[...truncated 10131 lines...]
[junit4] Suite: org.apache.solr.cloud.AsyncMigrateRouteKeyTest
[junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/init-core-data-001
[junit4] 2> 1459428 T8334 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /c_i/n
[junit4] 2> 1459433 T8334 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1459433 T8335 oasc.ZkTestServer$2$1.setClientPort client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1459434 T8335 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1459533 T8334 oasc.ZkTestServer.run start zk server on port:60185
[junit4] 2> 1459534 T8334 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1459534 T8334 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1459538 T8342 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6b388257 name:ZooKeeperConnection Watcher:127.0.0.1:60185 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1459538 T8334 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1459538 T8334 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1459539 T8334 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1459541 T8334 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1459541 T8334 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1459542 T8345 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e7219e name:ZooKeeperConnection Watcher:127.0.0.1:60185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1459542 T8334 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1459543 T8334 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1459543 T8334 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1459544 T8334 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1459545 T8334 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1459546 T8334 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1459548 T8334 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1459548 T8334 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1459550 T8334 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1459551 T8334 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1459653 T8334 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1459653 T8334 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1459655 T8334 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1459655 T8334 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1459657 T8334 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1459657 T8334 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1459659 T8334 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1459659 T8334 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1459661 T8334 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1459661 T8334 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1459663 T8334 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1459663 T8334 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1459665 T8334 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1459665 T8334 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1459666 T8334 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1459667 T8334 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1459668 T8334 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1459669 T8334 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1461100 T8334 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/control-001/cores/collection1
[junit4] 2> 1461103 T8334 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1461107 T8334 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60189
[junit4] 2> 1461108 T8334 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/c_i/n, hostPort=60189, coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/control-001/cores, solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/tempDir-001/control/data}
[junit4] 2> 1461108 T8334 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@231bf785
[junit4] 2> 1461108 T8334 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/control-001/'
[junit4] 2> 1461145 T8334 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/control-001/solr.xml
[junit4] 2> 1461186 T8334 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/control-001/cores
[junit4] 2> 1461187 T8334 oasc.CoreContainer.<init> New CoreContainer 2096947886
[junit4] 2> 1461187 T8334 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/control-001/]
[junit4] 2> 1461187 T8334 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/control-001/lib
[junit4] 2> 1461188 T8334 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/control-001/lib).
[junit4] 2> 1461197 T8334 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1461202 T8334 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1461203 T8334 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1461203 T8334 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1461203 T8334 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 1461204 T8334 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60185/solr
[junit4] 2> 1461204 T8334 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1461204 T8334 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1461205 T8334 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1461206 T8357 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c7aead2 name:ZooKeeperConnection Watcher:127.0.0.1:60185 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1461207 T8334 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1461208 T8334 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1461209 T8334 N:127.0.0.1:60189_c_i%2Fn oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1461210 T8360 N:127.0.0.1:60189_c_i%2Fn oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@46b67e1 name:ZooKeeperConnection Watcher:127.0.0.1:60185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1461210 T8334 N:127.0.0.1:60189_c_i%2Fn oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1461211 T8334 N:127.0.0.1:60189_c_i%2Fn oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1461213 T8334 N:127.0.0.1:60189_c_i%2Fn oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1461214 T8334 N:127.0.0.1:60189_c_i%2Fn oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1461216 T8334 N:127.0.0.1:60189_c_i%2Fn oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1461217 T8334 N:127.0.0.1:60189_c_i%2Fn oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1461219 T8334 N:127.0.0.1:60189_c_i%2Fn oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1461220 T8334 N:127.0.0.1:60189_c_i%2Fn oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1461221 T8334 N:127.0.0.1:60189_c_i%2Fn oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1461222 T8334 N:127.0.0.1:60189_c_i%2Fn oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60189_c_i%2Fn
[junit4] 2> 1461223 T8334 N:127.0.0.1:60189_c_i%2Fn oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60189_c_i%2Fn
[junit4] 2> 1461224 T8334 N:127.0.0.1:60189_c_i%2Fn oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1461225 T8334 N:127.0.0.1:60189_c_i%2Fn oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1461226 T8334 N:127.0.0.1:60189_c_i%2Fn oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1461227 T8334 N:127.0.0.1:60189_c_i%2Fn oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:60189_c_i%2Fn
[junit4] 2> 1461227 T8334 N:127.0.0.1:60189_c_i%2Fn oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1461228 T8334 N:127.0.0.1:60189_c_i%2Fn oasc.Overseer.start Overseer (id=93659552554745859-127.0.0.1:60189_c_i%2Fn-n_0000000000) starting
[junit4] 2> 1461230 T8334 N:127.0.0.1:60189_c_i%2Fn oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1461234 T8334 N:127.0.0.1:60189_c_i%2Fn oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1461235 T8362 N:127.0.0.1:60189_c_i%2Fn oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1461235 T8334 N:127.0.0.1:60189_c_i%2Fn oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1461235 T8361 N:127.0.0.1:60189_c_i%2Fn oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1461238 T8334 N:127.0.0.1:60189_c_i%2Fn oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/control-001/cores
[junit4] 2> 1461242 T8334 N:127.0.0.1:60189_c_i%2Fn oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {dataDir=data/, name=collection1, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/control-001/cores/collection1, collection=control_collection, schema=schema.xml, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/control-001/cores/collection1/, loadOnStartup=true, coreNodeName=, config=solrconfig.xml, shard=, transient=false}
[junit4] 2> 1461242 T8334 N:127.0.0.1:60189_c_i%2Fn oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/control-001/cores/collection1/
[junit4] 2> 1461242 T8334 N:127.0.0.1:60189_c_i%2Fn oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1461243 T8364 N:127.0.0.1:60189_c_i%2Fn C:control_collection c:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 1461243 T8364 N:127.0.0.1:60189_c_i%2Fn C:control_collection c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1461244 T8364 N:127.0.0.1:60189_c_i%2Fn oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1461244 T8360 N:127.0.0.1:60189_c_i%2Fn oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1461244 T8361 N:127.0.0.1:60189_c_i%2Fn oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "node_name":"127.0.0.1:60189_c_i%2Fn",
[junit4] 2> "state":"down",
[junit4] 2> "numShards":"1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":null,
[junit4] 2> "core":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:60189/c_i/n",
[junit4] 2> "roles":null} current state version: 0
[junit4] 2> 1461245 T8361 N:127.0.0.1:60189_c_i%2Fn oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "node_name":"127.0.0.1:60189_c_i%2Fn",
[junit4] 2> "state":"down",
[junit4] 2> "numShards":"1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":null,
[junit4] 2> "core":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:60189/c_i/n",
[junit4] 2> "roles":null}
[junit4] 2> 1461245 T8361 N:127.0.0.1:60189_c_i%2Fn oasco.ClusterStateMutator.createCollection building a new cName: control_collection
[junit4] 2> 1461245 T8361 N:127.0.0.1:60189_c_i%2Fn oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1461246 T8360 N:127.0.0.1:60189_c_i%2Fn oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1462244 T8364 N:127.0.0.1:60189_c_i%2Fn oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1462245 T8364 N:127.0.0.1:60189_c_i%2Fn oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1462245 T8364 N:127.0.0.1:60189_c_i%2Fn oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1462246 T8364 N:127.0.0.1:60189_c_i%2Fn oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1462246 T8364 N:127.0.0.1:60189_c_i%2Fn oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1462247 T8364 N:127.0.0.1:60189_c_i%2Fn oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/control-001/cores/collection1/'
[junit4] 2> 1462268 T8364 N:127.0.0.1:60189_c_i%2Fn oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 1462271 T8364 N:127.0.0.1:60189_c_i%2Fn oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 1462285 T8364 N:127.0.0.1:60189_c_i%2Fn oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 1462313 T8364 N:127.0.0.1:60189_c_i%2Fn oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 1462375 T8364 N:127.0.0.1:60189_c_i%2Fn oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1462476 T8364 N:127.0.0.1:60189_c_i%2Fn oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1462487 T8364 N:127.0.0.1:60189_c_i%2Fn oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1462902 T8364 N:127.0.0.1:60189_c_i%2Fn oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1462906 T8364 N:127.0.0.1:60189_c_i%2Fn oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1462908 T8364 N:127.0.0.1:60189_c_i%2Fn oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1462913 T8364 N:127.0.0.1:60189_c_i%2Fn oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1462928 T8364 N:127.0.0.1:60189_c_i%2Fn oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1462929 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1462929 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/control-001/cores/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/control-001/cores/collection1/data/
[junit4] 2> 1462929 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b789d5f
[junit4] 2> 1462930 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/control-001/cores/collection1/data
[junit4] 2> 1462930 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/control-001/cores/collection1/data/index/
[junit4] 2> 1462931 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1462931 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/control-001/cores/collection1/data/index
[junit4] 2> 1462932 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=33, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.109909495811727]
[junit4] 2> 1462932 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@486fe011 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@28dfa13e),segFN=segments_1,generation=1}
[junit4] 2> 1462933 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1462938 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1462939 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1462939 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1462939 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1462940 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1462940 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1462940 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1462941 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1462941 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1462985 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1463002 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1463007 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1463010 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1463016 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /get,/admin/plugins,/update,/admin/system,/config,/admin/ping,/admin/segments,/schema,/update/csv,/update/json,/admin/threads,/admin/mbeans,standard,/admin/logging,/admin/properties,/admin/luke,/replication,/admin/file,/update/json/docs
[junit4] 2> 1463020 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1463022 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1463022 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
[junit4] 2> 1463025 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1463026 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1463027 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1239401654, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1463028 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@486fe011 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@28dfa13e),segFN=segments_1,generation=1}
[junit4] 2> 1463028 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1463028 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@1dfe231[collection1] main
[junit4] 2> 1463029 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1463030 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1463030 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1463030 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1463031 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1463031 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1463031 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1463032 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1463032 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1463032 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 1463033 T8365 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1dfe231[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1463034 T8364 N:127.0.0.1:60189_c_i%2Fn c:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1463034 T8368 N:127.0.0.1:60189_c_i%2Fn C:control_collection S:shard1 c:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60189/c_i/n collection:control_collection shard:shard1
[junit4] 2> 1463035 T8334 N:127.0.0.1:60189_c_i%2Fn oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0
[junit4] 2> 1463035 T8334 N:127.0.0.1:60189_c_i%2Fn oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1463035 T8368 N:127.0.0.1:60189_c_i%2Fn C:control_collection S:shard1 c:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1463037 T8334 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1463037 T8334 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1463039 T8371 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@51949ec7 name:ZooKeeperConnection Watcher:127.0.0.1:60185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1463039 T8334 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1463039 T8368 N:127.0.0.1:60189_c_i%2Fn C:control_collection S:shard1 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1463039 T8334 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1463040 T8334 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1463040 T8360 N:127.0.0.1:60189_c_i%2Fn oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1463041 T8368 N:127.0.0.1:60189_c_i%2Fn C:control_collection S:shard1 c:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1463041 T8368 N:127.0.0.1:60189_c_i%2Fn C:control_collection S:shard1 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1043 name=collection1 org.apache.solr.core.SolrCore@2e06f48d url=http://127.0.0.1:60189/c_i/n/collection1 node=127.0.0.1:60189_c_i%2Fn C1043_STATE=coll:control_collection core:collection1 props:{node_name=127.0.0.1:60189_c_i%2Fn, state=down, core=collection1, base_url=http://127.0.0.1:60189/c_i/n}
[junit4] 2> 1463041 T8368 N:127.0.0.1:60189_c_i%2Fn C:control_collection S:shard1 c:collection1 C1043 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60189/c_i/n/collection1/
[junit4] 2> 1463041 T8361 N:127.0.0.1:60189_c_i%2Fn oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 1463041 T8368 N:127.0.0.1:60189_c_i%2Fn C:control_collection S:shard1 c:collection1 C1043 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1463042 T8334 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1463042 T8368 N:127.0.0.1:60189_c_i%2Fn C:control_collection S:shard1 c:collection1 C1043 oasc.SyncStrategy.syncToMe http://127.0.0.1:60189/c_i/n/collection1/ has no replicas
[junit4] 2> 1463042 T8334 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
[junit4] 2> 1463042 T8368 N:127.0.0.1:60189_c_i%2Fn C:control_collection S:shard1 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60189/c_i/n/collection1/ shard1
[junit4] 2> 1463042 T8334 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1463042 T8360 N:127.0.0.1:60189_c_i%2Fn oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1463042 T8371 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1463042 T8368 N:127.0.0.1:60189_c_i%2Fn C:control_collection S:shard1 c:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1463043 T8334 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1463044 T8374 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@73b3d847 name:ZooKeeperConnection Watcher:127.0.0.1:60185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1463044 T8334 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1463044 T8334 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1463045 T8360 N:127.0.0.1:60189_c_i%2Fn oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1463046 T8361 N:127.0.0.1:60189_c_i%2Fn oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2"} current state version: 2
[junit4] 2> 1463047 T8361 N:127.0.0.1:60189_c_i%2Fn oasco.ClusterStateMutator.createCollection building a new cName: collection1
[junit4] 2> 1463049 T8361 N:127.0.0.1:60189_c_i%2Fn oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:60189/c_i/n",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 2
[junit4] 2> 1463049 T8361 N:127.0.0.1:60189_c_i%2Fn oasco.ZkStateWriter.writePendingUpdates going to create_collection /collections/collection1/state.json
[junit4] 2> 1463050 T8360 N:127.0.0.1:60189_c_i%2Fn oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1463050 T8371 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1463052 T8360 N:127.0.0.1:60189_c_i%2Fn oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1463053 T8371 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1463053 T8360 N:127.0.0.1:60189_c_i%2Fn oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1463097 T8368 N:127.0.0.1:60189_c_i%2Fn C:control_collection S:shard1 c:collection1 oasc.ZkController.register We are http://127.0.0.1:60189/c_i/n/collection1/ and leader is http://127.0.0.1:60189/c_i/n/collection1/
[junit4] 2> 1463098 T8368 N:127.0.0.1:60189_c_i%2Fn C:control_collection S:shard1 c:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60189/c_i/n
[junit4] 2> 1463098 T8368 N:127.0.0.1:60189_c_i%2Fn C:control_collection S:shard1 c:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1463098 T8368 N:127.0.0.1:60189_c_i%2Fn C:control_collection S:shard1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 1463099 T8368 N:127.0.0.1:60189_c_i%2Fn C:control_collection S:shard1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1463100 T8360 N:127.0.0.1:60189_c_i%2Fn oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1463101 T8361 N:127.0.0.1:60189_c_i%2Fn oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "node_name":"127.0.0.1:60189_c_i%2Fn",
[junit4] 2> "state":"active",
[junit4] 2> "numShards":"2",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:60189/c_i/n",
[junit4] 2> "roles":null} current state version: 4
[junit4] 2> 1463101 T8361 N:127.0.0.1:60189_c_i%2Fn oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "node_name":"127.0.0.1:60189_c_i%2Fn",
[junit4] 2> "state":"active",
[junit4] 2> "numShards":"2",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:60189/c_i/n",
[junit4] 2> "roles":null}
[junit4] 2> 1463204 T8371 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1463204 T8360 N:127.0.0.1:60189_c_i%2Fn oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1464117 T8334 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/shard-1-001/cores/collection1
[junit4] 2> 1464120 T8334 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 in directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/shard-1-001
[junit4] 2> 1464121 T8334 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1464126 T8334 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60205
[junit4] 2> 1464127 T8334 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/c_i/n, hostPort=60205, coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/shard-1-001/cores, solrconfig=solrconfig.xml, solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/tempDir-001/jetty1}
[junit4] 2> 1464128 T8334 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@231bf785
[junit4] 2> 1464128 T8334 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/shard-1-001/'
[junit4] 2> 1464183 T8334 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/shard-1-001/solr.xml
[junit4] 2> 1464251 T8334 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/shard-1-001/cores
[junit4] 2> 1464252 T8334 oasc.CoreContainer.<init> New CoreContainer 1669429168
[junit4] 2> 1464252 T8334 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/shard-1-001/]
[junit4] 2> 1464253 T8334 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/shard-1-001/lib
[junit4] 2> 1464254 T8334 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/shard-1-001/lib).
[junit4] 2> 1464268 T8334 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1464278 T8334 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1464279 T8334 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1464279 T8334 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1464280 T8334 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 1464280 T8334 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60185/solr
[junit4] 2> 1464280 T8334 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1464281 T8334 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1464281 T8334 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1464283 T8386 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d4dcbbe name:ZooKeeperConnection Watcher:127.0.0.1:60185 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1464284 T8334 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1464285 T8334 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1464286 T8334 N:127.0.0.1:60205_c_i%2Fn oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1464288 T8389 N:127.0.0.1:60205_c_i%2Fn oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2163bc4b name:ZooKeeperConnection Watcher:127.0.0.1:60185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1464288 T8334 N:127.0.0.1:60205_c_i%2Fn oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1464292 T8334 N:127.0.0.1:60205_c_i%2Fn oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1465297 T8334 N:127.0.0.1:60205_c_i%2Fn oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60205_c_i%2Fn
[junit4] 2> 1465298 T8334 N:127.0.0.1:60205_c_i%2Fn oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60205_c_i%2Fn
[junit4] 2> 1465300 T8334 N:127.0.0.1:60205_c_i%2Fn oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1465303 T8334 N:127.0.0.1:60205_c_i%2Fn oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/shard-1-001/cores
[junit4] 2> 1465309 T8334 N:127.0.0.1:60205_c_i%2Fn oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {schema=schema.xml, transient=false, dataDir=data/, name=collection1, config=solrconfig.xml, shard=, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/shard-1-001/cores/collection1, loadOnStartup=true, collection=collection1, coreNodeName=, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/shard-1-001/cores/collection1/}
[junit4] 2> 1465309 T8334 N:127.0.0.1:60205_c_i%2Fn oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/shard-1-001/cores/collection1/
[junit4] 2> 1465309 T8334 N:127.0.0.1:60205_c_i%2Fn oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1465311 T8390 N:127.0.0.1:60205_c_i%2Fn C:collection1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1465312 T8390 N:127.0.0.1:60205_c_i%2Fn C:collection1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1465313 T8360 N:127.0.0.1:60189_c_i%2Fn oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1465313 T8390 N:127.0.0.1:60205_c_i%2Fn oasc.ZkController.preRegister Registering watch for external collection collection1
[junit4] 2> 1465313 T8390 N:127.0.0.1:60205_c_i%2Fn oascc.ZkStateReader.addZkWatch addZkWatch collection1
[junit4] 2> 1465313 T8361 N:127.0.0.1:60189_c_i%2Fn oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "node_name":"127.0.0.1:60205_c_i%2Fn",
[junit4] 2> "state":"down",
[junit4] 2> "numShards":"2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":null,
[junit4] 2> "core":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:60205/c_i/n",
[junit4] 2> "roles":null} current state version: 5
[junit4] 2> 1465314 T8390 N:127.0.0.1:60205_c_i%2Fn oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper...
[junit4] 2> 1465314 T8361 N:127.0.0.1:60189_c_i%2Fn oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "node_name":"127.0.0.1:60205_c_i%2Fn",
[junit4] 2> "state":"down",
[junit4] 2> "numShards":"2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":null,
[junit4] 2> "core":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:60205/c_i/n",
[junit4] 2> "roles":null}
[junit4] 2> 1465314 T8361 N:127.0.0.1:60189_c_i%2Fn oasco.ReplicaMutator.updateState Collection already exists with numShards=2
[junit4] 2> 1465314 T8361 N:127.0.0.1:60189_c_i%2Fn oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1465315 T8390 N:127.0.0.1:60205_c_i%2Fn oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 0
[junit4] 2> 1465315 T8390 N:127.0.0.1:60205_c_i%2Fn oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1465316 T8361 N:127.0.0.1:60189_c_i%2Fn oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 0
[junit4] 2> 1465316 T8389 N:127.0.0.1:60205_c_i%2Fn oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
[junit4] 2> 1465317 T8389 N:127.0.0.1:60205_c_i%2Fn oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 1
[junit4] 2> 1466315 T8390 N:127.0.0.1:60205_c_i%2Fn oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1466316 T8390 N:127.0.0.1:60205_c_i%2Fn oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1466316 T8390 N:127.0.0.1:60205_c_i%2Fn oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1466316 T8390 N:127.0.0.1:60205_c_i%2Fn oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1466317 T8390 N:127.0.0.1:60205_c_i%2Fn oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1466317 T8390 N:127.0.0.1:60205_c_i%2Fn oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/shard-1-001/cores/collection1/'
[junit4] 2> 1466332 T8390 N:127.0.0.1:60205_c_i%2Fn oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 1466334 T8390 N:127.0.0.1:60205_c_i%2Fn oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 1466344 T8390 N:127.0.0.1:60205_c_i%2Fn oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 1466362 T8390 N:127.0.0.1:60205_c_i%2Fn oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 1466404 T8390 N:127.0.0.1:60205_c_i%2Fn oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1466505 T8390 N:127.0.0.1:60205_c_i%2Fn oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1466512 T8390 N:127.0.0.1:60205_c_i%2Fn oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1466806 T8390 N:127.0.0.1:60205_c_i%2Fn oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1466809 T8390 N:127.0.0.1:60205_c_i%2Fn oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1466810 T8390 N:127.0.0.1:60205_c_i%2Fn oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1466814 T8390 N:127.0.0.1:60205_c_i%2Fn oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1466824 T8390 N:127.0.0.1:60205_c_i%2Fn oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1466824 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1466825 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/shard-1-001/cores/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/shard-1-001/cores/collection1/data/
[junit4] 2> 1466825 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b789d5f
[junit4] 2> 1466825 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/shard-1-001/cores/collection1/data
[junit4] 2> 1466826 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/shard-1-001/cores/collection1/data/index/
[junit4] 2> 1466826 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1466826 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.AsyncMigrateRouteKeyTest 79D1DF19120705EE-001/shard-1-001/cores/collection1/data/index
[junit4] 2> 1466826 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=33, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.109909495811727]
[junit4] 2> 1466827 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@506f17c6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2d81f16b),segFN=segments_1,generation=1}
[junit4] 2> 1466827 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1466832 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1466832 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1466832 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1466832 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1466833 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1466833 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1466833 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1466833 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1466833 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1466854 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1466856 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1466858 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1466859 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1466864 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /get,/admin/plugins,/update,/admin/system,/config,/admin/ping,/admin/segments,/schema,/update/csv,/update/json,/admin/threads,/admin/mbeans,standard,/admin/logging,/admin/properties,/admin/luke,/replication,/admin/file,/update/json/docs
[junit4] 2> 1466866 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1466868 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1466868 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
[junit4] 2> 1466870 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1466870 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1466872 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1239401654, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1466873 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@506f17c6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2d81f16b),segFN=segments_1,generation=1}
[junit4] 2> 1466873 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1466873 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@40df6f6c[collection1] main
[junit4] 2> 1466873 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1466874 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1466874 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1466874 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1466874 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1466875 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1466875 T8390 N:127.0.0.1:60205_c_i%2Fn c:collection1 oasr.ManagedResourceStorage$ZooKeeper
[...truncated too long message...]
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 2) Thread[id=8397, name=qtp405453587-8397, state=RUNNABLE, group=TGRP-AsyncMigrateRouteKeyTest]
[junit4] > at java.util.WeakHashMap.get(WeakHashMap.java:471)
[junit4] > at org.apache.solr.servlet.cache.HttpCacheHeaderUtil.calcEtag(HttpCacheHeaderUtil.java:101)
[junit4] > at org.apache.solr.servlet.cache.HttpCacheHeaderUtil.doCacheHeaderValidation(HttpCacheHeaderUtil.java:219)
[junit4] > at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:444)
[junit4] > at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:223)
[junit4] > at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] > at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:104)
[junit4] > at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] > at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] > at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] > at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] > at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] > at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] > at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] > at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] > at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] > at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] > at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] > at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] > at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] > at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
[junit4] > at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
[junit4] > at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
[junit4] > at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
[junit4] > at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
[junit4] > at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
[junit4] > at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([79D1DF19120705EE]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=8411, name=searcherExecutor-2792-thread-1, state=WAITING, group=TGRP-AsyncMigrateRouteKeyTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 2) Thread[id=8397, name=qtp405453587-8397, state=RUNNABLE, group=TGRP-AsyncMigrateRouteKeyTest]
[junit4] > at java.util.WeakHashMap.get(WeakHashMap.java:471)
[junit4] > at org.apache.solr.servlet.cache.HttpCacheHeaderUtil.calcEtag(HttpCacheHeaderUtil.java:101)
[junit4] > at org.apache.solr.servlet.cache.HttpCacheHeaderUtil.doCacheHeaderValidation(HttpCacheHeaderUtil.java:219)
[junit4] > at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:444)
[junit4] > at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:223)
[junit4] > at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] > at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:104)
[junit4] > at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] > at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] > at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] > at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] > at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] > at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] > at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] > at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] > at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] > at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] > at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] > at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] > at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] > at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
[junit4] > at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
[junit4] > at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
[junit4] > at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
[junit4] > at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
[junit4] > at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
[junit4] > at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([79D1DF19120705EE]:0)
[junit4] Completed [268/483] on J0 in 256.45s, 1 test, 2 failures, 2 errors <<< FAILURES!
[...truncated 667 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:536: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:484: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:61: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/extra-targets.xml:39: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build.xml:229: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/common-build.xml:511: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:1434: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:991: There were test failures: 483 suites, 1916 tests, 3 suite-level errors, 1 failure, 910 ignored (21 assumptions)
Total time: 50 minutes 16 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-5.x-Java7 #2952
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 173904137 bytes
Compression is 0.0%
Took 31 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-5.x-Java7 - Build # 2954 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.x-Java7/2954/
1 tests failed.
REGRESSION: org.apache.solr.cloud.RecoveryAfterSoftCommitTest.test
Error Message:
Didn't see all replicas for shard shard1 in collection1 come up within 30000 ms! ClusterState: { "control_collection":{ "autoAddReplicas":"false", "replicationFactor":"1", "autoCreated":"true", "router":{"name":"compositeId"}, "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{"core_node1":{ "base_url":"http://127.0.0.1:29428/kc_xc/h", "state":"active", "node_name":"127.0.0.1:29428_kc_xc%2Fh", "core":"collection1", "leader":"true"}}}}, "maxShardsPerNode":"1"}, "collection1":{ "autoAddReplicas":"false", "replicationFactor":"1", "autoCreated":"true", "router":{"name":"compositeId"}, "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node1":{ "base_url":"http://127.0.0.1:29437/kc_xc/h", "state":"active", "node_name":"127.0.0.1:29437_kc_xc%2Fh", "core":"collection1", "leader":"true"}, "core_node2":{ "base_url":"http://127.0.0.1:29470/kc_xc/h", "state":"recovering", "node_name":"127.0.0.1:29470_kc_xc%2Fh", "core":"collection1"}}}}, "maxShardsPerNode":"1"}}
Stack Trace:
java.lang.AssertionError: Didn't see all replicas for shard shard1 in collection1 come up within 30000 ms! ClusterState: {
"control_collection":{
"autoAddReplicas":"false",
"replicationFactor":"1",
"autoCreated":"true",
"router":{"name":"compositeId"},
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{"core_node1":{
"base_url":"http://127.0.0.1:29428/kc_xc/h",
"state":"active",
"node_name":"127.0.0.1:29428_kc_xc%2Fh",
"core":"collection1",
"leader":"true"}}}},
"maxShardsPerNode":"1"},
"collection1":{
"autoAddReplicas":"false",
"replicationFactor":"1",
"autoCreated":"true",
"router":{"name":"compositeId"},
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node1":{
"base_url":"http://127.0.0.1:29437/kc_xc/h",
"state":"active",
"node_name":"127.0.0.1:29437_kc_xc%2Fh",
"core":"collection1",
"leader":"true"},
"core_node2":{
"base_url":"http://127.0.0.1:29470/kc_xc/h",
"state":"recovering",
"node_name":"127.0.0.1:29470_kc_xc%2Fh",
"core":"collection1"}}}},
"maxShardsPerNode":"1"}}
at __randomizedtesting.SeedInfo.seed([59E161ADE29E2E45:D1B55E774C6243BD]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.ensureAllReplicasAreActive(AbstractFullDistribZkTestBase.java:1920)
at org.apache.solr.cloud.RecoveryAfterSoftCommitTest.test(RecoveryAfterSoftCommitTest.java:102)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10068 lines...]
[junit4] Suite: org.apache.solr.cloud.RecoveryAfterSoftCommitTest
[junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/init-core-data-001
[junit4] 2> 1293753 T3904 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /kc_xc/h
[junit4] 2> 1293758 T3904 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1293758 T3905 oasc.ZkTestServer$2$1.setClientPort client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1293758 T3905 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1293858 T3904 oasc.ZkTestServer.run start zk server on port:29405
[junit4] 2> 1293859 T3904 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1293860 T3904 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1293863 T3912 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6200de10 name:ZooKeeperConnection Watcher:127.0.0.1:29405 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1293863 T3904 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1293863 T3904 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1293863 T3904 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1293866 T3904 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1293866 T3904 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1293867 T3915 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@52f1f296 name:ZooKeeperConnection Watcher:127.0.0.1:29405/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1293867 T3904 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1293868 T3904 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1293868 T3904 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1293869 T3904 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1293870 T3904 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1293871 T3904 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1293873 T3904 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1293873 T3904 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1293875 T3904 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1293875 T3904 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1293978 T3904 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1293978 T3904 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1293979 T3904 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1293980 T3904 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1293981 T3904 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1293982 T3904 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1293983 T3904 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1293983 T3904 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1293984 T3904 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1293985 T3904 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1293986 T3904 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1293986 T3904 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1293988 T3904 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1293988 T3904 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1293989 T3904 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1293990 T3904 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1293991 T3904 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1293991 T3904 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1295499 T3904 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/control-001/cores/collection1
[junit4] 2> 1295502 T3904 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1295505 T3904 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:29429
[junit4] 2> 1295505 T3904 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostPort=29428, coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/control-001/cores, solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/tempDir-001/control/data, hostContext=/kc_xc/h}
[junit4] 2> 1295505 T3904 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@17072b90
[junit4] 2> 1295506 T3904 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/control-001/'
[junit4] 2> 1295544 T3904 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/control-001/solr.xml
[junit4] 2> 1295581 T3904 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/control-001/cores
[junit4] 2> 1295581 T3904 oasc.CoreContainer.<init> New CoreContainer 1746096438
[junit4] 2> 1295581 T3904 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/control-001/]
[junit4] 2> 1295581 T3904 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/control-001/lib
[junit4] 2> 1295582 T3904 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/control-001/lib).
[junit4] 2> 1295591 T3904 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1295595 T3904 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1295596 T3904 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1295597 T3904 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1295597 T3904 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 1295597 T3904 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:29405/solr
[junit4] 2> 1295597 T3904 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1295597 T3904 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1295598 T3904 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1295600 T3927 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32960baf name:ZooKeeperConnection Watcher:127.0.0.1:29405 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1295601 T3904 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1295601 T3904 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1295603 T3904 N:127.0.0.1:29428_kc_xc%2Fh oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1295604 T3930 N:127.0.0.1:29428_kc_xc%2Fh oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70e7ace name:ZooKeeperConnection Watcher:127.0.0.1:29405/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1295604 T3904 N:127.0.0.1:29428_kc_xc%2Fh oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1295605 T3904 N:127.0.0.1:29428_kc_xc%2Fh oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1295606 T3904 N:127.0.0.1:29428_kc_xc%2Fh oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1295607 T3904 N:127.0.0.1:29428_kc_xc%2Fh oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1295609 T3904 N:127.0.0.1:29428_kc_xc%2Fh oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1295610 T3904 N:127.0.0.1:29428_kc_xc%2Fh oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1295611 T3904 N:127.0.0.1:29428_kc_xc%2Fh oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1295612 T3904 N:127.0.0.1:29428_kc_xc%2Fh oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1295613 T3904 N:127.0.0.1:29428_kc_xc%2Fh oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1295613 T3904 N:127.0.0.1:29428_kc_xc%2Fh oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:29428_kc_xc%2Fh
[junit4] 2> 1295614 T3904 N:127.0.0.1:29428_kc_xc%2Fh oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:29428_kc_xc%2Fh
[junit4] 2> 1295615 T3904 N:127.0.0.1:29428_kc_xc%2Fh oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1295615 T3904 N:127.0.0.1:29428_kc_xc%2Fh oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1295616 T3904 N:127.0.0.1:29428_kc_xc%2Fh oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1295617 T3904 N:127.0.0.1:29428_kc_xc%2Fh oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:29428_kc_xc%2Fh
[junit4] 2> 1295617 T3904 N:127.0.0.1:29428_kc_xc%2Fh oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1295618 T3904 N:127.0.0.1:29428_kc_xc%2Fh oasc.Overseer.start Overseer (id=93660415731499011-127.0.0.1:29428_kc_xc%2Fh-n_0000000000) starting
[junit4] 2> 1295619 T3904 N:127.0.0.1:29428_kc_xc%2Fh oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1295623 T3904 N:127.0.0.1:29428_kc_xc%2Fh oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1295623 T3932 N:127.0.0.1:29428_kc_xc%2Fh oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1295623 T3931 N:127.0.0.1:29428_kc_xc%2Fh oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1295623 T3904 N:127.0.0.1:29428_kc_xc%2Fh oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1295626 T3904 N:127.0.0.1:29428_kc_xc%2Fh oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/control-001/cores
[junit4] 2> 1295628 T3904 N:127.0.0.1:29428_kc_xc%2Fh oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/control-001/cores/collection1/, collection=control_collection, schema=schema.xml, name=collection1, dataDir=data/, shard=, coreNodeName=, transient=false, config=solrconfig.xml, loadOnStartup=true, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/control-001/cores/collection1}
[junit4] 2> 1295628 T3904 N:127.0.0.1:29428_kc_xc%2Fh oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/control-001/cores/collection1/
[junit4] 2> 1295628 T3904 N:127.0.0.1:29428_kc_xc%2Fh oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1295629 T3934 N:127.0.0.1:29428_kc_xc%2Fh C:control_collection c:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 1295629 T3934 N:127.0.0.1:29428_kc_xc%2Fh C:control_collection c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1295629 T3934 N:127.0.0.1:29428_kc_xc%2Fh oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1295629 T3930 N:127.0.0.1:29428_kc_xc%2Fh oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1295630 T3931 N:127.0.0.1:29428_kc_xc%2Fh oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:29428/kc_xc/h",
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "node_name":"127.0.0.1:29428_kc_xc%2Fh",
[junit4] 2> "core":"collection1"} current state version: 0
[junit4] 2> 1295630 T3931 N:127.0.0.1:29428_kc_xc%2Fh oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:29428/kc_xc/h",
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "node_name":"127.0.0.1:29428_kc_xc%2Fh",
[junit4] 2> "core":"collection1"}
[junit4] 2> 1295631 T3931 N:127.0.0.1:29428_kc_xc%2Fh oasco.ClusterStateMutator.createCollection building a new cName: control_collection
[junit4] 2> 1295631 T3931 N:127.0.0.1:29428_kc_xc%2Fh oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1295632 T3930 N:127.0.0.1:29428_kc_xc%2Fh oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1296630 T3934 N:127.0.0.1:29428_kc_xc%2Fh oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1296631 T3934 N:127.0.0.1:29428_kc_xc%2Fh oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1296631 T3934 N:127.0.0.1:29428_kc_xc%2Fh oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1296632 T3934 N:127.0.0.1:29428_kc_xc%2Fh oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1296632 T3934 N:127.0.0.1:29428_kc_xc%2Fh oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1296632 T3934 N:127.0.0.1:29428_kc_xc%2Fh oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/control-001/cores/collection1/'
[junit4] 2> 1296649 T3934 N:127.0.0.1:29428_kc_xc%2Fh oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 1296651 T3934 N:127.0.0.1:29428_kc_xc%2Fh oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 1296662 T3934 N:127.0.0.1:29428_kc_xc%2Fh oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 1296683 T3934 N:127.0.0.1:29428_kc_xc%2Fh oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 1296730 T3934 N:127.0.0.1:29428_kc_xc%2Fh oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1296833 T3934 N:127.0.0.1:29428_kc_xc%2Fh oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1296843 T3934 N:127.0.0.1:29428_kc_xc%2Fh oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1297153 T3934 N:127.0.0.1:29428_kc_xc%2Fh oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1297164 T3934 N:127.0.0.1:29428_kc_xc%2Fh oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1297165 T3934 N:127.0.0.1:29428_kc_xc%2Fh oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1297173 T3934 N:127.0.0.1:29428_kc_xc%2Fh oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1297176 T3934 N:127.0.0.1:29428_kc_xc%2Fh oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1297178 T3934 N:127.0.0.1:29428_kc_xc%2Fh oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1297179 T3934 N:127.0.0.1:29428_kc_xc%2Fh oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1297179 T3934 N:127.0.0.1:29428_kc_xc%2Fh oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1297179 T3934 N:127.0.0.1:29428_kc_xc%2Fh oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1297180 T3934 N:127.0.0.1:29428_kc_xc%2Fh oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1297180 T3934 N:127.0.0.1:29428_kc_xc%2Fh oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1297180 T3934 N:127.0.0.1:29428_kc_xc%2Fh oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1297180 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1297180 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/control-001/cores/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/control-001/cores/collection1/data/
[junit4] 2> 1297181 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@48e65d42
[junit4] 2> 1297181 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/control-001/cores/collection1/data
[junit4] 2> 1297181 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/control-001/cores/collection1/data/index/
[junit4] 2> 1297182 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1297182 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/control-001/cores/collection1/data/index
[junit4] 2> 1297182 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=1.7958984375, floorSegmentMB=0.2626953125, forceMergeDeletesPctAllowed=20.192678086005422, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1297183 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@50742b03 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7ab3fb38),segFN=segments_1,generation=1}
[junit4] 2> 1297183 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1297187 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1297187 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1297187 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1297187 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1297187 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1297188 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1297188 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1297188 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1297188 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1297200 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1297202 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1297203 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1297204 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1297208 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/threads,/replication,/update/json,/admin/segments,/admin/luke,standard,/schema,/update,/admin/properties,/admin/plugins,/admin/logging,/admin/mbeans,/admin/file,/admin/ping,/update/json/docs,/get,/update/csv,/admin/system,/config
[junit4] 2> 1297209 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1297210 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1297210 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
[junit4] 2> 1297211 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1297211 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1297212 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=45, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 1297212 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@50742b03 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7ab3fb38),segFN=segments_1,generation=1}
[junit4] 2> 1297212 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1297213 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@7f6ca9a2[collection1] main
[junit4] 2> 1297213 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1297214 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1297214 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1297214 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1297214 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1297214 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1297215 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1297215 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1297215 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1297215 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 1297216 T3934 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1297216 T3935 N:127.0.0.1:29428_kc_xc%2Fh c:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7f6ca9a2[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1297216 T3938 N:127.0.0.1:29428_kc_xc%2Fh C:control_collection S:shard1 c:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:29428/kc_xc/h collection:control_collection shard:shard1
[junit4] 2> 1297217 T3904 N:127.0.0.1:29428_kc_xc%2Fh oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0
[junit4] 2> 1297217 T3904 N:127.0.0.1:29428_kc_xc%2Fh oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1297217 T3938 N:127.0.0.1:29428_kc_xc%2Fh C:control_collection S:shard1 c:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1297219 T3904 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1297220 T3904 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1297221 T3938 N:127.0.0.1:29428_kc_xc%2Fh C:control_collection S:shard1 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1297222 T3942 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c674b4d name:ZooKeeperConnection Watcher:127.0.0.1:29405/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1297222 T3904 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1297222 T3904 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1297223 T3904 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1297223 T3930 N:127.0.0.1:29428_kc_xc%2Fh oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1297223 T3938 N:127.0.0.1:29428_kc_xc%2Fh C:control_collection S:shard1 c:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1297224 T3938 N:127.0.0.1:29428_kc_xc%2Fh C:control_collection S:shard1 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C785 name=collection1 org.apache.solr.core.SolrCore@96757a4 url=http://127.0.0.1:29428/kc_xc/h/collection1 node=127.0.0.1:29428_kc_xc%2Fh C785_STATE=coll:control_collection core:collection1 props:{base_url=http://127.0.0.1:29428/kc_xc/h, state=down, node_name=127.0.0.1:29428_kc_xc%2Fh, core=collection1}
[junit4] 2> 1297224 T3938 N:127.0.0.1:29428_kc_xc%2Fh C:control_collection S:shard1 c:collection1 C785 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:29428/kc_xc/h/collection1/
[junit4] 2> 1297224 T3938 N:127.0.0.1:29428_kc_xc%2Fh C:control_collection S:shard1 c:collection1 C785 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1297224 T3931 N:127.0.0.1:29428_kc_xc%2Fh oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 1297225 T3938 N:127.0.0.1:29428_kc_xc%2Fh C:control_collection S:shard1 c:collection1 C785 oasc.SyncStrategy.syncToMe http://127.0.0.1:29428/kc_xc/h/collection1/ has no replicas
[junit4] 2> 1297225 T3938 N:127.0.0.1:29428_kc_xc%2Fh C:control_collection S:shard1 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:29428/kc_xc/h/collection1/ shard1
[junit4] 2> 1297225 T3938 N:127.0.0.1:29428_kc_xc%2Fh C:control_collection S:shard1 c:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1297225 T3904 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1297226 T3930 N:127.0.0.1:29428_kc_xc%2Fh oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1297226 T3942 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1297229 T3930 N:127.0.0.1:29428_kc_xc%2Fh oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1297230 T3931 N:127.0.0.1:29428_kc_xc%2Fh oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:29428/kc_xc/h",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 2
[junit4] 2> 1297332 T3942 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1297332 T3930 N:127.0.0.1:29428_kc_xc%2Fh oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1297381 T3938 N:127.0.0.1:29428_kc_xc%2Fh C:control_collection S:shard1 c:collection1 oasc.ZkController.register We are http://127.0.0.1:29428/kc_xc/h/collection1/ and leader is http://127.0.0.1:29428/kc_xc/h/collection1/
[junit4] 2> 1297382 T3938 N:127.0.0.1:29428_kc_xc%2Fh C:control_collection S:shard1 c:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:29428/kc_xc/h
[junit4] 2> 1297382 T3938 N:127.0.0.1:29428_kc_xc%2Fh C:control_collection S:shard1 c:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1297382 T3938 N:127.0.0.1:29428_kc_xc%2Fh C:control_collection S:shard1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 1297382 T3938 N:127.0.0.1:29428_kc_xc%2Fh C:control_collection S:shard1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1297383 T3930 N:127.0.0.1:29428_kc_xc%2Fh oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1297384 T3931 N:127.0.0.1:29428_kc_xc%2Fh oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:29428/kc_xc/h",
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "numShards":"1",
[junit4] 2> "node_name":"127.0.0.1:29428_kc_xc%2Fh",
[junit4] 2> "core":"collection1"} current state version: 3
[junit4] 2> 1297384 T3931 N:127.0.0.1:29428_kc_xc%2Fh oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:29428/kc_xc/h",
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "numShards":"1",
[junit4] 2> "node_name":"127.0.0.1:29428_kc_xc%2Fh",
[junit4] 2> "core":"collection1"}
[junit4] 2> 1297487 T3930 N:127.0.0.1:29428_kc_xc%2Fh oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1297487 T3942 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1298421 T3904 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-1-001/cores/collection1
[junit4] 2> 1298423 T3904 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 in directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-1-001
[junit4] 2> 1298423 T3904 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1298426 T3904 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:29438
[junit4] 2> 1298426 T3904 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostPort=29437, solrconfig=solrconfig.xml, solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/tempDir-001/jetty1, coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-1-001/cores, hostContext=/kc_xc/h}
[junit4] 2> 1298427 T3904 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@17072b90
[junit4] 2> 1298427 T3904 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-1-001/'
[junit4] 2> 1298458 T3904 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-1-001/solr.xml
[junit4] 2> 1298495 T3904 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-1-001/cores
[junit4] 2> 1298496 T3904 oasc.CoreContainer.<init> New CoreContainer 10760237
[junit4] 2> 1298496 T3904 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-1-001/]
[junit4] 2> 1298496 T3904 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-1-001/lib
[junit4] 2> 1298497 T3904 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-1-001/lib).
[junit4] 2> 1298506 T3904 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1298511 T3904 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1298512 T3904 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1298512 T3904 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1298513 T3904 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 1298513 T3904 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:29405/solr
[junit4] 2> 1298513 T3904 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1298513 T3904 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1298514 T3904 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1298516 T3954 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c6c6c8 name:ZooKeeperConnection Watcher:127.0.0.1:29405 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1298516 T3904 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1298517 T3904 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1298519 T3904 N:127.0.0.1:29437_kc_xc%2Fh oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1298520 T3957 N:127.0.0.1:29437_kc_xc%2Fh oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@39eefea3 name:ZooKeeperConnection Watcher:127.0.0.1:29405/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1298520 T3904 N:127.0.0.1:29437_kc_xc%2Fh oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1298523 T3904 N:127.0.0.1:29437_kc_xc%2Fh oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1299527 T3904 N:127.0.0.1:29437_kc_xc%2Fh oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:29437_kc_xc%2Fh
[junit4] 2> 1299528 T3904 N:127.0.0.1:29437_kc_xc%2Fh oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:29437_kc_xc%2Fh
[junit4] 2> 1299531 T3904 N:127.0.0.1:29437_kc_xc%2Fh oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1299533 T3904 N:127.0.0.1:29437_kc_xc%2Fh oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-1-001/cores
[junit4] 2> 1299534 T3904 N:127.0.0.1:29437_kc_xc%2Fh oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {schema=schema.xml, transient=false, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-1-001/cores/collection1/, config=solrconfig.xml, shard=, loadOnStartup=true, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-1-001/cores/collection1, coreNodeName=, dataDir=data/, name=collection1, collection=collection1}
[junit4] 2> 1299535 T3904 N:127.0.0.1:29437_kc_xc%2Fh oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-1-001/cores/collection1/
[junit4] 2> 1299535 T3904 N:127.0.0.1:29437_kc_xc%2Fh oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1299536 T3958 N:127.0.0.1:29437_kc_xc%2Fh C:collection1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1299536 T3958 N:127.0.0.1:29437_kc_xc%2Fh C:collection1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1299537 T3958 N:127.0.0.1:29437_kc_xc%2Fh oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1299537 T3930 N:127.0.0.1:29428_kc_xc%2Fh oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1299537 T3931 N:127.0.0.1:29428_kc_xc%2Fh oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:29437/kc_xc/h",
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "node_name":"127.0.0.1:29437_kc_xc%2Fh",
[junit4] 2> "core":"collection1"} current state version: 4
[junit4] 2> 1299538 T3931 N:127.0.0.1:29428_kc_xc%2Fh oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:29437/kc_xc/h",
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "node_name":"127.0.0.1:29437_kc_xc%2Fh",
[junit4] 2> "core":"collection1"}
[junit4] 2> 1299538 T3931 N:127.0.0.1:29428_kc_xc%2Fh oasco.ClusterStateMutator.createCollection building a new cName: collection1
[junit4] 2> 1299538 T3931 N:127.0.0.1:29428_kc_xc%2Fh oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1299539 T3930 N:127.0.0.1:29428_kc_xc%2Fh oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1299539 T3957 N:127.0.0.1:29437_kc_xc%2Fh oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1299539 T3942 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1300537 T3958 N:127.0.0.1:29437_kc_xc%2Fh oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1300538 T3958 N:127.0.0.1:29437_kc_xc%2Fh oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1300538 T3958 N:127.0.0.1:29437_kc_xc%2Fh oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1300539 T3958 N:127.0.0.1:29437_kc_xc%2Fh oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1300539 T3958 N:127.0.0.1:29437_kc_xc%2Fh oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1300539 T3958 N:127.0.0.1:29437_kc_xc%2Fh oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-1-001/cores/collection1/'
[junit4] 2> 1300557 T3958 N:127.0.0.1:29437_kc_xc%2Fh oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 1300560 T3958 N:127.0.0.1:29437_kc_xc%2Fh oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 1300571 T3958 N:127.0.0.1:29437_kc_xc%2Fh oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 1300594 T3958 N:127.0.0.1:29437_kc_xc%2Fh oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 1300734 T3958 N:127.0.0.1:29437_kc_xc%2Fh oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1300837 T3958 N:127.0.0.1:29437_kc_xc%2Fh oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1300848 T3958 N:127.0.0.1:29437_kc_xc%2Fh oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1301256 T3958 N:127.0.0.1:29437_kc_xc%2Fh oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1301272 T3958 N:127.0.0.1:29437_kc_xc%2Fh oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1301275 T3958 N:127.0.0.1:29437_kc_xc%2Fh oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1301283 T3958 N:127.0.0.1:29437_kc_xc%2Fh oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1301287 T3958 N:127.0.0.1:29437_kc_xc%2Fh oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1301291 T3958 N:127.0.0.1:29437_kc_xc%2Fh oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1301292 T3958 N:127.0.0.1:29437_kc_xc%2Fh oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1301292 T3958 N:127.0.0.1:29437_kc_xc%2Fh oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1301293 T3958 N:127.0.0.1:29437_kc_xc%2Fh oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1301293 T3958 N:127.0.0.1:29437_kc_xc%2Fh oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1301293 T3958 N:127.0.0.1:29437_kc_xc%2Fh oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1301294 T3958 N:127.0.0.1:29437_kc_xc%2Fh oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1301294 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1301294 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-1-001/cores/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-1-001/cores/collection1/data/
[junit4] 2> 1301295 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@48e65d42
[junit4] 2> 1301296 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-1-001/cores/collection1/data
[junit4] 2> 1301296 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-1-001/cores/collection1/data/index/
[junit4] 2> 1301296 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1301297 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-1-001/cores/collection1/data/index
[junit4] 2> 1301297 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=1.7958984375, floorSegmentMB=0.2626953125, forceMergeDeletesPctAllowed=20.192678086005422, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1301298 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@27724c04 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@40dcaed7),segFN=segments_1,generation=1}
[junit4] 2> 1301298 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1301306 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1301306 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1301307 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1301307 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1301307 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1301307 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1301308 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1301308 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1301308 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1301339 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1301342 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1301345 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1301348 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1301355 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/threads,/replication,/update/json,/admin/segments,/admin/luke,standard,/schema,/update,/admin/properties,/admin/plugins,/admin/logging,/admin/mbeans,/admin/file,/admin/ping,/update/json/docs,/get,/update/csv,/admin/system,/config
[junit4] 2> 1301358 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1301361 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1301361 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
[junit4] 2> 1301364 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1301364 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1301366 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=45, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 1301367 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@27724c04 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@40dcaed7),segFN=segments_1,generation=1}
[junit4] 2> 1301367 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1301367 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@6ddc9273[collection1] main
[junit4] 2> 1301368 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1301368 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1301369 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1301369 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1301369 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1301370 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1301370 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1301370 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1301371 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1301371 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 1301372 T3959 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6ddc9273[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1301373 T3958 N:127.0.0.1:29437_kc_xc%2Fh c:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1301374 T3962 N:127.0.0.1:29437_kc_xc%2Fh C:collection1 S:shard1 c:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:29437/kc_xc/h collection:collection1 shard:shard1
[junit4] 2> 1301374 T3904 N:127.0.0.1:29437_kc_xc%2Fh oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0
[junit4] 2> 1301375 T3904 N:127.0.0.1:29437_kc_xc%2Fh oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1301375 T3962 N:127.0.0.1:29437_kc_xc%2Fh C:collection1 S:shard1 c:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1301379 T3962 N:127.0.0.1:29437_kc_xc%2Fh C:collection1 S:shard1 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1301381 T3930 N:127.0.0.1:29428_kc_xc%2Fh oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1301381 T3962 N:127.0.0.1:29437_kc_xc%2Fh C:collection1 S:shard1 c:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1301382 T3962 N:127.0.0.1:29437_kc_xc%2Fh C:collection1 S:shard1 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C786 name=collection1 org.apache.solr.core.SolrCore@ec3e0f1 url=http://127.0.0.1:29437/kc_xc/h/collection1 node=127.0.0.1:29437_kc_xc%2Fh C786_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:29437/kc_xc/h, state=down, node_name=127.0.0.1:29437_kc_xc%2Fh, core=collection1}
[junit4] 2> 1301382 T3962 N:127.0.0.1:29437_kc_xc%2Fh C:collection1 S:shard1 c:collection1 C786 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:29437/kc_xc/h/collection1/
[junit4] 2> 1301382 T3931 N:127.0.0.1:29428_kc_xc%2Fh oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1"} current state version: 5
[junit4] 2> 1301382 T3962 N:127.0.0.1:29437_kc_xc%2Fh C:collection1 S:shard1 c:collection1 C786 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1301383 T3962 N:127.0.0.1:29437_kc_xc%2Fh C:collection1 S:shard1 c:collection1 C786 oasc.SyncStrategy.syncToMe http://127.0.0.1:29437/kc_xc/h/collection1/ has no replicas
[junit4] 2> 1301383 T3962 N:127.0.0.1:29437_kc_xc%2Fh C:collection1 S:shard1 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:29437/kc_xc/h/collection1/ shard1
[junit4] 2> 1301383 T3962 N:127.0.0.1:29437_kc_xc%2Fh C:collection1 S:shard1 c:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1301384 T3942 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1301384 T3930 N:127.0.0.1:29428_kc_xc%2Fh oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1301384 T3957 N:127.0.0.1:29437_kc_xc%2Fh oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1301387 T3930 N:127.0.0.1:29428_kc_xc%2Fh oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1301388 T3931 N:127.0.0.1:29428_kc_xc%2Fh oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:29437/kc_xc/h",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 6
[junit4] 2> 1301492 T3957 N:127.0.0.1:29437_kc_xc%2Fh oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1301492 T3942 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1301492 T3930 N:127.0.0.1:29428_kc_xc%2Fh oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1301540 T3962 N:127.0.0.1:29437_kc_xc%2Fh C:collection1 S:shard1 c:collection1 oasc.ZkController.register We are http://127.0.0.1:29437/kc_xc/h/collection1/ and leader is http://127.0.0.1:29437/kc_xc/h/collection1/
[junit4] 2> 1301541 T3962 N:127.0.0.1:29437_kc_xc%2Fh C:collection1 S:shard1 c:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:29437/kc_xc/h
[junit4] 2> 1301541 T3962 N:127.0.0.1:29437_kc_xc%2Fh C:collection1 S:shard1 c:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1301541 T3962 N:127.0.0.1:29437_kc_xc%2Fh C:collection1 S:shard1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 1301541 T3962 N:127.0.0.1:29437_kc_xc%2Fh C:collection1 S:shard1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1301543 T3930 N:127.0.0.1:29428_kc_xc%2Fh oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1301543 T3931 N:127.0.0.1:29428_kc_xc%2Fh oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:29437/kc_xc/h",
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "numShards":"1",
[junit4] 2> "node_name":"127.0.0.1:29437_kc_xc%2Fh",
[junit4] 2> "core":"collection1"} current state version: 7
[junit4] 2> 1301544 T3931 N:127.0.0.1:29428_kc_xc%2Fh oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:29437/kc_xc/h",
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "numShards":"1",
[junit4] 2> "node_name":"127.0.0.1:29437_kc_xc%2Fh",
[junit4] 2> "core":"collection1"}
[junit4] 2> 1301647 T3930 N:127.0.0.1:29428_kc_xc%2Fh oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1301647 T3957 N:127.0.0.1:29437_kc_xc%2Fh oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1301647 T3942 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1303042 T3904 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-2-001/cores/collection1
[junit4] 2> 1303045 T3904 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2 in directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-2-001
[junit4] 2> 1303046 T3904 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1303049 T3904 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:29471
[junit4] 2> 1303049 T3904 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/kc_xc/h, solrconfig=solrconfig.xml, hostPort=29470, coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-2-001/cores, solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/tempDir-001/jetty2}
[junit4] 2> 1303050 T3904 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@17072b90
[junit4] 2> 1303050 T3904 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-2-001/'
[junit4] 2> 1303094 T3904 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-2-001/solr.xml
[junit4] 2> 1303156 T3904 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-2-001/cores
[junit4] 2> 1303156 T3904 oasc.CoreContainer.<init> New CoreContainer 1487590568
[junit4] 2> 1303156 T3904 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-2-001/]
[junit4] 2> 1303157 T3904 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-2-001/lib
[junit4] 2> 1303158 T3904 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-2-001/lib).
[junit4] 2> 1303172 T3904 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1303181 T3904 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1303182 T3904 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1303183 T3904 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1303183 T3904 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 1303183 T3904 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:29405/solr
[junit4] 2> 1303184 T3904 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1303184 T3904 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1303185 T3904 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1303187 T3975 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53d59c7b name:ZooKeeperConnection Watcher:127.0.0.1:29405 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1303188 T3904 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1303188 T3904 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1303191 T3904 N:127.0.0.1:29470_kc_xc%2Fh oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1303192 T3978 N:127.0.0.1:29470_kc_xc%2Fh oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@50c40b56 name:ZooKeeperConnection Watcher:127.0.0.1:29405/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1303192 T3904 N:127.0.0.1:29470_kc_xc%2Fh oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1303197 T3904 N:127.0.0.1:29470_kc_xc%2Fh oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1304200 T3904 N:127.0.0.1:29470_kc_xc%2Fh oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:29470_kc_xc%2Fh
[junit4] 2> 1304201 T3904 N:127.0.0.1:29470_kc_xc%2Fh oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:29470_kc_xc%2Fh
[junit4] 2> 1304204 T3904 N:127.0.0.1:29470_kc_xc%2Fh oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1304206 T3904 N:127.0.0.1:29470_kc_xc%2Fh oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-2-001/cores
[junit4] 2> 1304209 T3904 N:127.0.0.1:29470_kc_xc%2Fh oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {config=solrconfig.xml, shard=, transient=false, name=collection1, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-2-001/cores/collection1/, coreNodeName=, schema=schema.xml, collection=collection1, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-2-001/cores/collection1, loadOnStartup=true, dataDir=data/}
[junit4] 2> 1304209 T3904 N:127.0.0.1:29470_kc_xc%2Fh oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-2-001/cores/collection1/
[junit4] 2> 1304209 T3904 N:127.0.0.1:29470_kc_xc%2Fh oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1304210 T3979 N:127.0.0.1:29470_kc_xc%2Fh C:collection1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1304211 T3979 N:127.0.0.1:29470_kc_xc%2Fh C:collection1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1304211 T3979 N:127.0.0.1:29470_kc_xc%2Fh oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1304211 T3930 N:127.0.0.1:29428_kc_xc%2Fh oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1304212 T3931 N:127.0.0.1:29428_kc_xc%2Fh oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:29470/kc_xc/h",
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "node_name":"127.0.0.1:29470_kc_xc%2Fh",
[junit4] 2> "core":"collection1"} current state version: 8
[junit4] 2> 1304212 T3931 N:127.0.0.1:29428_kc_xc%2Fh oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:29470/kc_xc/h",
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "node_name":"127.0.0.1:29470_kc_xc%2Fh",
[junit4] 2> "core":"collection1"}
[junit4] 2> 1304213 T3931 N:127.0.0.1:29428_kc_xc%2Fh oasco.ReplicaMutator.updateState Collection already exists with numShards=1
[junit4] 2> 1304213 T3931 N:127.0.0.1:29428_kc_xc%2Fh oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1304214 T3942 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1304214 T3957 N:127.0.0.1:29437_kc_xc%2Fh oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1304214 T3930 N:127.0.0.1:29428_kc_xc%2Fh oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1304214 T3978 N:127.0.0.1:29470_kc_xc%2Fh oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1305212 T3979 N:127.0.0.1:29470_kc_xc%2Fh oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1305213 T3979 N:127.0.0.1:29470_kc_xc%2Fh oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1305213 T3979 N:127.0.0.1:29470_kc_xc%2Fh oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1305214 T3979 N:127.0.0.1:29470_kc_xc%2Fh oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1305214 T3979 N:127.0.0.1:29470_kc_xc%2Fh o
[...truncated too long message...]
ld/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-2-001/cores/collection1/data
[junit4] 2> 1407882 T3978 N:127.0.0.1:29470_kc_xc%2Fh oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-2-001/cores/collection1/data/index.20150416033546589 [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-2-001/cores/collection1/data/index.20150416033546589;done=false>>]
[junit4] 2> 1407882 T3978 N:127.0.0.1:29470_kc_xc%2Fh oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001/shard-2-001/cores/collection1/data/index.20150416033546589
[junit4] 2> 1407884 T3904 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/kc_xc/h,null}
[junit4] 2> 1408049 T3904 C:control_collection S:shard1 c:collection1 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:29405 29405
[junit4] 2> 1408146 T3905 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:29405 29405
[junit4] 2> 1408148 T3905 oasc.ZkTestServer$ZKServerMain.runFromConfig WARN Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/aliases.json
[junit4] 2> 4 /solr/clusterstate.json
[junit4] 2> 3 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/live_nodes
[junit4] 2> 3 /solr/overseer/collection-queue-work
[junit4] 2> 3 /solr/overseer/queue
[junit4] 2>
[junit4] 2> 1408149 T3904 C:control_collection S:shard1 c:collection1 oasc.SocketProxy.close WARN Closing 6 connections to: http://127.0.0.1:29437/kc_xc/h, target: http://127.0.0.1:29438/kc_xc/h
[junit4] 2> 1408149 T3904 C:control_collection S:shard1 c:collection1 oasc.SocketProxy.close WARN Closing 1 connections to: http://127.0.0.1:29470/kc_xc/h, target: http://127.0.0.1:29471/kc_xc/h
[junit4] 2> 1408149 T3904 C:control_collection S:shard1 c:collection1 oasc.SocketProxy.close WARN Closing 0 connections to: http://127.0.0.1:29428/kc_xc/h, target: http://127.0.0.1:29429/kc_xc/h
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=RecoveryAfterSoftCommitTest -Dtests.method=test -Dtests.seed=59E161ADE29E2E45 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=ga -Dtests.timezone=Asia/Qatar -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 114s J0 | RecoveryAfterSoftCommitTest.test <<<
[junit4] > Throwable #1: java.lang.AssertionError: Didn't see all replicas for shard shard1 in collection1 come up within 30000 ms! ClusterState: {
[junit4] > "control_collection":{
[junit4] > "autoAddReplicas":"false",
[junit4] > "replicationFactor":"1",
[junit4] > "autoCreated":"true",
[junit4] > "router":{"name":"compositeId"},
[junit4] > "shards":{"shard1":{
[junit4] > "range":"80000000-7fffffff",
[junit4] > "state":"active",
[junit4] > "replicas":{"core_node1":{
[junit4] > "base_url":"http://127.0.0.1:29428/kc_xc/h",
[junit4] > "state":"active",
[junit4] > "node_name":"127.0.0.1:29428_kc_xc%2Fh",
[junit4] > "core":"collection1",
[junit4] > "leader":"true"}}}},
[junit4] > "maxShardsPerNode":"1"},
[junit4] > "collection1":{
[junit4] > "autoAddReplicas":"false",
[junit4] > "replicationFactor":"1",
[junit4] > "autoCreated":"true",
[junit4] > "router":{"name":"compositeId"},
[junit4] > "shards":{"shard1":{
[junit4] > "range":"80000000-7fffffff",
[junit4] > "state":"active",
[junit4] > "replicas":{
[junit4] > "core_node1":{
[junit4] > "base_url":"http://127.0.0.1:29437/kc_xc/h",
[junit4] > "state":"active",
[junit4] > "node_name":"127.0.0.1:29437_kc_xc%2Fh",
[junit4] > "core":"collection1",
[junit4] > "leader":"true"},
[junit4] > "core_node2":{
[junit4] > "base_url":"http://127.0.0.1:29470/kc_xc/h",
[junit4] > "state":"recovering",
[junit4] > "node_name":"127.0.0.1:29470_kc_xc%2Fh",
[junit4] > "core":"collection1"}}}},
[junit4] > "maxShardsPerNode":"1"}}
[junit4] > at __randomizedtesting.SeedInfo.seed([59E161ADE29E2E45:D1B55E774C6243BD]:0)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.ensureAllReplicasAreActive(AbstractFullDistribZkTestBase.java:1920)
[junit4] > at org.apache.solr.cloud.RecoveryAfterSoftCommitTest.test(RecoveryAfterSoftCommitTest.java:102)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 1408163 T3904 C:control_collection S:shard1 c:collection1 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryAfterSoftCommitTest 59E161ADE29E2E45-001
[junit4] 2> 114414 T3903 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {id=PostingsFormat(name=LuceneVarGapDocFreqInterval), multiDefault=Lucene50(blocksize=128), intDefault=FSTOrd50, _version_=FSTOrd50, range_facet_l=Lucene50(blocksize=128), a_t=Lucene50(blocksize=128), text=BlockTreeOrds(blocksize=128), timestamp=Lucene50(blocksize=128)}, docValues:{timestamp=DocValuesFormat(name=Direct)}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=ga, timezone=Asia/Qatar
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=1,free=71381752,total=282591232
[junit4] 2> NOTE: All tests run in this JVM: [TestSolrXml, AnalyticsMergeStrategyTest, TestSolrDeletionPolicy1, TestNamedUpdateProcessors, VMParamsZkACLAndCredentialsProvidersTest, TestPivotHelperCode, ConnectionManagerTest, SpellCheckComponentTest, TestCSVLoader, BJQParserTest, TestSimpleQParserPlugin, EchoParamsTest, LukeRequestHandlerTest, CacheHeaderTest, TestStressLucene, TestTrackingShardHandlerFactory, AtomicUpdatesTest, TestSolrQueryParserResource, TestPhraseSuggestions, HdfsCollectionsAPIDistributedZkTest, MergeStrategyTest, FieldAnalysisRequestHandlerTest, TestFileDictionaryLookup, HdfsWriteToMultipleCollectionsTest, FastVectorHighlighterTest, DebugComponentTest, SpellPossibilityIteratorTest, TestMergePolicyConfig, TestPostingsSolrHighlighter, TestDefaultStatsCache, TestAddFieldRealTimeGet, DocValuesMissingTest, TestDefaultSimilarityFactory, HttpPartitionTest, TestManagedSchemaFieldTypeResource, TestCursorMarkWithoutUniqueKey, TestIntervalFaceting, ReturnFieldsTest, NumericFieldsTest, TestPseudoReturnFields, TestNoOpRegenerator, TestInfoStreamLogging, DirectSolrSpellCheckerTest, TestFastLRUCache, DistributedQueryElevationComponentTest, TestShortCircuitedRequests, ConcurrentDeleteAndCreateCollectionTest, SliceStateTest, WordBreakSolrSpellCheckerTest, BasicDistributedZkTest, TestHashPartitioner, XsltUpdateRequestHandlerTest, TestBulkSchemaConcurrent, TestNRTOpen, OverseerStatusTest, SuggesterTSTTest, TestDocSet, ConvertedLegacyTest, TestQueryTypes, ShardSplitTest, RecoveryAfterSoftCommitTest]
[junit4] Completed [250/483] on J0 in 114.94s, 1 test, 1 failure <<< FAILURES!
[...truncated 734 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:536: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:484: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:61: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/extra-targets.xml:39: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build.xml:229: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/common-build.xml:511: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:1434: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:991: There were test failures: 483 suites, 1916 tests, 1 failure, 64 ignored (23 assumptions)
Total time: 52 minutes 29 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-5.x-Java7 #2952
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 219574323 bytes
Compression is 0.0%
Took 42 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure