You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/08/09 11:18:49 UTC
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_11) - Build #
10984 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10984/
Java: 32bit/jdk1.8.0_11 -server -XX:+UseSerialGC
5 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.rest.TestManagedResourceStorage
Error Message:
SolrCore.getOpenCount()==2
Stack Trace:
java.lang.RuntimeException: SolrCore.getOpenCount()==2
at __randomizedtesting.SeedInfo.seed([F23C49693D060B40]:0)
at org.apache.solr.util.TestHarness.close(TestHarness.java:332)
at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:630)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:181)
at sun.reflect.GeneratedMethodAccessor30.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:790)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.rest.TestManagedResourceStorage
Error Message:
4 threads leaked from SUITE scope at org.apache.solr.rest.TestManagedResourceStorage: 1) Thread[id=7702, name=Thread-2991, state=WAITING, group=TGRP-TestManagedResourceStorage] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.solr.core.CloserThread.run(CoreContainer.java:894) 2) Thread[id=7704, name=coreZkRegister-4177-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 3) Thread[id=7701, name=searcherExecutor-4183-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 4) Thread[id=7697, name=Thread-2990, state=TIMED_WAITING, group=Overseer state updater.] at java.lang.Object.wait(Native Method) at org.apache.solr.cloud.DistributedQueue$LatchChildWatcher.await(DistributedQueue.java:266) at org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQueue.java:309) at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:582) at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:560) at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:217) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE scope at org.apache.solr.rest.TestManagedResourceStorage:
1) Thread[id=7702, name=Thread-2991, state=WAITING, group=TGRP-TestManagedResourceStorage]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.solr.core.CloserThread.run(CoreContainer.java:894)
2) Thread[id=7704, name=coreZkRegister-4177-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
3) Thread[id=7701, name=searcherExecutor-4183-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
4) Thread[id=7697, name=Thread-2990, state=TIMED_WAITING, group=Overseer state updater.]
at java.lang.Object.wait(Native Method)
at org.apache.solr.cloud.DistributedQueue$LatchChildWatcher.await(DistributedQueue.java:266)
at org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQueue.java:309)
at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:582)
at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:560)
at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:217)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([F23C49693D060B40]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.rest.TestManagedResourceStorage
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=7702, name=Thread-2991, state=WAITING, group=TGRP-TestManagedResourceStorage] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.solr.core.CloserThread.run(CoreContainer.java:894) 2) Thread[id=7704, name=coreZkRegister-4177-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 3) Thread[id=7701, name=searcherExecutor-4183-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=7702, name=Thread-2991, state=WAITING, group=TGRP-TestManagedResourceStorage]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.solr.core.CloserThread.run(CoreContainer.java:894)
2) Thread[id=7704, name=coreZkRegister-4177-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
3) Thread[id=7701, name=searcherExecutor-4183-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([F23C49693D060B40]:0)
REGRESSION: org.apache.solr.cloud.OverseerTest.testOverseerFailure
Error Message:
Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
Stack Trace:
org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
at __randomizedtesting.SeedInfo.seed([F23C49693D060B40:F634C69A2FA3E461]:0)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:144)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:314)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:155)
at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:660)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.solr.common.cloud.SolrZkClient$11.execute(SolrZkClient.java:457)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:454)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:411)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:398)
at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:136)
at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:31)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:131)
... 46 more
REGRESSION: org.apache.solr.schema.TestCloudSchemaless.testDistribSearch
Error Message:
Timeout occured while waiting response from server at: https://127.0.0.1:60454/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: https://127.0.0.1:60454/collection1
at __randomizedtesting.SeedInfo.seed([F23C49693D060B40:73DAC7714A596B7C]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:561)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:124)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:68)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:54)
at org.apache.solr.schema.TestCloudSchemaless.doTest(TestCloudSchemaless.java:140)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:150)
at java.net.SocketInputStream.read(SocketInputStream.java:121)
at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
at sun.security.ssl.InputRecord.read(InputRecord.java:503)
at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:954)
at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:911)
at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:449)
... 47 more
Build Log:
[...truncated 11371 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.OverseerTest-F23C49693D060B40-001/init-core-data-001
[junit4] 2> 667274 T1903 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 667274 T1903 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 667274 T1903 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 667277 T1903 oas.SolrTestCaseJ4.setUp ###Starting testShardLeaderChange
[junit4] 2> 667278 T1903 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 667278 T1904 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 667378 T1903 oasc.ZkTestServer.run start zk server on port:32873
[junit4] 2> 667379 T1903 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 667383 T1910 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75ba2 name:ZooKeeperConnection Watcher:127.0.0.1:32873/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 667383 T1903 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 667384 T1903 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 667385 T1912 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8a8fd6 name:ZooKeeperConnection Watcher:127.0.0.1:32873 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 667385 T1903 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 667388 T1903 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 667388 T1914 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15d01ae name:ZooKeeperConnection Watcher:127.0.0.1:32873 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 667389 T1903 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 667389 T1903 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 667391 T1903 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 667394 T1915 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 667395 T1903 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 667395 T1917 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8c2015 name:ZooKeeperConnection Watcher:127.0.0.1:32873/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 667396 T1915 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 667397 T1915 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 667397 T1919 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@118c108 name:ZooKeeperConnection Watcher:127.0.0.1:32873/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 667397 T1903 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 667398 T1903 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 667398 T1915 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 667399 T1903 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 667400 T1903 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 667400 T1915 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:32873_solr
[junit4] 2> 667400 T1915 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 667402 T1903 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 667402 T1915 oasc.Overseer.start Overseer (id=92246754957852675-127.0.0.1:32873_solr-n_0000000000) starting
[junit4] 2> 667403 T1915 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 667408 T1903 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 667409 T1915 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 667411 T1915 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 667412 T1915 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 667414 T1915 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 667416 T1915 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 667418 T1915 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
[junit4] 2> 667418 T1922 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 667419 T1922 oasc.OverseerCollectionProcessor.amILeader org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.amILeader(OverseerCollectionProcessor.java:514)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:227)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 667419 T1922 oasc.OverseerCollectionProcessor.amILeader According to ZK I (id=92246754957852675-127.0.0.1:32873_solr-n_0000000000) am no longer a leader.
[junit4] 2> 667419 T1915 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 667420 T1922 oasc.SolrException.log ERROR :org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/collection-queue-work
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:285)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.orderedChildren(DistributedQueue.java:99)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.getTailId(DistributedQueue.java:483)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:241)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 667420 T1922 oasc.OverseerCollectionProcessor.run ERROR Unable to prioritize overseer org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /roles.json
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:251)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:248)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:248)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.prioritizeOverseerNodes(OverseerCollectionProcessor.java:412)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:256)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 667420 T1922 oasc.OverseerCollectionProcessor.amILeader org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.amILeader(OverseerCollectionProcessor.java:514)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:269)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 667421 T1924 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4bdab4 name:ZooKeeperConnection Watcher:127.0.0.1:32873/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 667421 T1922 oasc.OverseerCollectionProcessor.amILeader According to ZK I (id=92246754957852675-127.0.0.1:32873_solr-n_0000000000) am no longer a leader.
[junit4] 2> 667421 T1915 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 667423 T1915 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:32873_solr
[junit4] 2> 667424 T1915 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 667425 T1915 oasc.Overseer.start Overseer (id=92246754957852677-127.0.0.1:32873_solr-n_0000000001) starting
[junit4] 2> 667429 T1926 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 667430 T1925 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 667431 T1925 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 667431 T1925 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 667432 T1925 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
[junit4] 2> 667432 T1925 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 667433 T1927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 667434 T1920 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 667910 T1903 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 667919 T1903 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 667922 T1927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 667923 T1903 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 667923 T1925 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 667926 T1925 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 667926 T1925 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 667930 T1925 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 667931 T1927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 667935 T1920 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 667936 T1903 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 667937 T1929 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d24182 name:ZooKeeperConnection Watcher:127.0.0.1:32873/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 667938 T1903 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 667938 T1903 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 667940 T1903 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 667942 T1927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 667942 T1903 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 667947 T1925 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 667948 T1925 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 667948 T1925 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 667953 T1903 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 667958 T1927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 667959 T1925 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node2",
[junit4] 2> "core":"core4",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node2/solr/"}
[junit4] 2> 667959 T1925 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4] 2> 667959 T1925 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 668061 T1920 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 668061 T1930 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 668458 T1903 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 668462 T1919 oaz.ClientCnxn$EventThread.processEvent ERROR Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1d63d7a rejected from java.util.concurrent.ThreadPoolExecutor@d4a564[Shutting down, pool size = 2, active threads = 2, queued tasks = 0, completed tasks = 5]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
[junit4] 2> at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:201)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 668462 T1931 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:285)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:204)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 668467 T1930 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 668470 T1927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 668471 T1925 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 668573 T1930 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 669962 T1920 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 669963 T1903 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 669964 T1903 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 669965 T1933 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16a9911 name:ZooKeeperConnection Watcher:127.0.0.1:32873/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 669966 T1903 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 669966 T1903 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 669968 T1903 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 669970 T1927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 669970 T1903 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 669971 T1925 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 669971 T1925 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 669972 T1925 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 669975 T1934 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 669977 T1927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 670033 T1915 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
[junit4] 2> 670035 T1915 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 670036 T1936 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@744b65 name:ZooKeeperConnection Watcher:127.0.0.1:32873/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 670036 T1915 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 670037 T1925 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:32873_solr
[junit4] 2> 670046 T1937 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 670046 T1915 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:32873_solr
[junit4] 2> 670046 T1915 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 670047 T1915 oasc.Overseer.start Overseer (id=92246754957852680-127.0.0.1:32873_solr-n_0000000002) starting
[junit4] 2> 670053 T1939 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 670055 T1938 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 670055 T1938 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4] 2> 670055 T1938 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 670056 T1938 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 670059 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 670061 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 670062 T1938 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 671474 T1930 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 671475 T1903 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 671475 T1940 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 671477 T1938 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 671477 T1938 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 671477 T1938 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 671479 T1903 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 671481 T1942 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@81a223 name:ZooKeeperConnection Watcher:127.0.0.1:32873/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 671482 T1903 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 671483 T1903 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 671484 T1903 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 671487 T1940 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 671487 T1903 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 671488 T1938 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 671488 T1938 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 671491 T1903 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 671492 T1940 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 671492 T1903 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 671493 T1938 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node2",
[junit4] 2> "core":"core4",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node2/solr/"}
[junit4] 2> 671493 T1938 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 671496 T1944 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:285)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:204)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 671498 T1943 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 671500 T1940 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 671603 T1943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 672996 T1934 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:285)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:204)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 672998 T1903 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 672999 T1903 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 673000 T1946 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1dc3e3a name:ZooKeeperConnection Watcher:127.0.0.1:32873/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 673001 T1903 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 673002 T1903 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 673003 T1903 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 673005 T1940 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 673006 T1903 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 673006 T1938 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 673007 T1938 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 673007 T1938 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 673011 T1947 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 673011 T1940 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 673012 T1903 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 673012 T1938 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 673012 T1938 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 673015 T1940 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 673015 T1903 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 673015 T1947 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 673017 T1949 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bb5d2 name:ZooKeeperConnection Watcher:127.0.0.1:32873/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 673017 T1903 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 673018 T1903 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 673020 T1903 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 673023 T1940 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 673023 T1903 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 673024 T1938 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 673025 T1938 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 673025 T1938 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 673027 T1903 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 673029 T1903 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 673029 T1940 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 673030 T1938 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node2",
[junit4] 2> "core":"core4",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node2/solr/"}
[junit4] 2> 673030 T1938 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 673034 T1950 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 673036 T1940 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 673056 T1915 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
[junit4] 2> 673056 T1905 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x147b9ef54f20008, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 673057 T1915 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 673058 T1953 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@176d08f name:ZooKeeperConnection Watcher:127.0.0.1:32873/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 673058 T1915 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 673059 T1938 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:32873_solr
[junit4] 2> 673060 T1954 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 673061 T1915 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:32873_solr
[junit4] 2> 673061 T1915 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 673063 T1915 oasc.Overseer.start Overseer (id=92246754957852684-127.0.0.1:32873_solr-n_0000000003) starting
[junit4] 2> 673068 T1956 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 673069 T1955 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 673070 T1955 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4] 2> 673070 T1955 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 673070 T1955 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 673071 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 673073 T1955 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node2",
[junit4] 2> "core":"core4",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node2/solr/"}
[junit4] 2> 673073 T1955 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 673074 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 673075 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 673076 T1955 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 674533 T1947 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:285)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:204)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 674534 T1951 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:285)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:204)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 674535 T1903 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 674537 T1903 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 674538 T1958 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12a03d3 name:ZooKeeperConnection Watcher:127.0.0.1:32873/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674538 T1903 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 674540 T1903 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 674541 T1903 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 674544 T1903 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 674544 T1960 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 674545 T1955 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 674545 T1955 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 674546 T1955 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 674548 T1959 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 674556 T1960 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 674569 T1915 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
[junit4] 2> 674571 T1915 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 674571 T1962 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bdc93c name:ZooKeeperConnection Watcher:127.0.0.1:32873/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674572 T1915 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 674572 T1955 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:32873_solr
[junit4] 2> 674574 T1963 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 674575 T1915 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:32873_solr
[junit4] 2> 674575 T1915 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 674576 T1915 oasc.Overseer.start Overseer (id=92246754957852686-127.0.0.1:32873_solr-n_0000000004) starting
[junit4] 2> 674580 T1965 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 674581 T1964 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 674581 T1964 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4] 2> 674581 T1964 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 674582 T1964 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 674582 T1959 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 674583 T1959 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 674584 T1964 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 676047 T1950 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 676049 T1903 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 676049 T1966 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 676050 T1964 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 676050 T1964 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 676051 T1964 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 676053 T1903 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 676055 T1968 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@db3c2f name:ZooKeeperConnection Watcher:127.0.0.1:32873/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 676055 T1903 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 676056 T1903 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 676058 T1903 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 676062 T1966 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 676062 T1903 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 676062 T1964 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 676062 T1964 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 676065 T1903 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 676066 T1903 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 676066 T1966 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 676067 T1964 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node2",
[junit4] 2> "core":"core4",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node2/solr/"}
[junit4] 2> 676067 T1964 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 676077 T1971 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 676080 T1966 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 676182 T1971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 677571 T1959 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:285)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:204)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 677571 T1970 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:285)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:282)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:204)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 677572 T1903 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 677573 T1903 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 677575 T1973 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36e6a0 name:ZooKeeperConnection Watcher:127.0.0.1:32873/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 677575 T1903 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 677576 T1903 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 677577 T1903 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 677579 T1966 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 677579 T1903 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 677580 T1964 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 677581 T1964 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 677581 T1964 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 677582 T1915 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
[junit4] 2> 677584 T1915 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 677584 T1976 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d53825 name:ZooKeeperConnection Watcher:127.0.0.1:32873/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 677585 T1915 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 677585 T1964 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:32873_solr
[junit4] 2> 677588 T1977 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at
[...truncated too long message...]
CheckLockOnStartupTest, TestSearchPerf, TestSolrDeletionPolicy1, TestBlendedInfixSuggestions, TestCloudSchemaless, IndexSchemaTest, TestSystemIdResolver, TestStandardQParsers, MBeansHandlerTest, LeaderElectionTest, TestCloudManagedSchema, TestAnalyzeInfixSuggestions, TestFastOutputStream, SolrIndexSplitterTest, ReplicationFactorTest, UUIDUpdateProcessorFallbackTest, TestHighlightDedupGrouping, LeaderElectionIntegrationTest, TestReplicationHandler, TestRangeQuery, SimpleFacetsTest, TestSolr4Spatial, SolrCmdDistributorTest, DistributedQueryElevationComponentTest, PolyFieldTest, TestPseudoReturnFields, TestAtomicUpdateErrorCases, XsltUpdateRequestHandlerTest, LukeRequestHandlerTest, TestWriterPerf, FileBasedSpellCheckerTest, TestValueSourceCache, TestSolrQueryParser, LoggingHandlerTest, RegexBoostProcessorTest, TestCollationField, UpdateRequestProcessorFactoryTest, TestCSVResponseWriter, BinaryUpdateRequestHandlerTest, TestPHPSerializedResponseWriter, TestComponentsName, SOLR749Test, UpdateParamsTest, TestSolrIndexConfig, TestMergePolicyConfig, TestSolrDeletionPolicy2, SampleTest, TestBinaryField, NumericFieldsTest, MinimalSchemaTest, TestConfig, OutputWriterTest, TestSolrCoreProperties, TestLuceneMatchVersion, TestSweetSpotSimilarityFactory, TestLMDirichletSimilarityFactory, TestFastWriter, TestJmxMonitoredMap, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, ChaosMonkeyNothingIsSafeTest, SolrTestCaseJ4Test, TestDistributedMissingSort, DeleteInactiveReplicaTest, DistribDocExpirationUpdateProcessorTest, ShardSplitTest, HdfsBasicDistributedZk2Test, HdfsBasicDistributedZkTest, HdfsChaosMonkeySafeLeaderTest, HdfsUnloadDistributedZkTest, HdfsWriteToMultipleCollectionsTest, StressHdfsTest, CachingDirectoryFactoryTest, QueryResultKeyTest, TestConfigSets, TestImplicitCoreProperties, TestInfoStreamLogging, TestShardHandlerFactory, TestSolrXml, TestSolrXmlPersistence, CoreMergeIndexesAdminHandlerTest, DistributedExpandComponentTest, DistributedQueryComponentCustomSortTest, DistributedQueryComponentOptimizationTest, DistributedSuggestComponentTest, SuggestComponentTest, HighlighterMaxOffsetTest, TestIntervalFaceting, TestManagedResourceStorage]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestManagedResourceStorage -Dtests.seed=F23C49693D060B40 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_IE -Dtests.timezone=Asia/Brunei -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | TestManagedResourceStorage (suite) <<<
[junit4] > Throwable #1: java.lang.RuntimeException: SolrCore.getOpenCount()==2
[junit4] > at __randomizedtesting.SeedInfo.seed([F23C49693D060B40]:0)
[junit4] > at org.apache.solr.util.TestHarness.close(TestHarness.java:332)
[junit4] > at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:630)
[junit4] > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:181)
[junit4] > at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE scope at org.apache.solr.rest.TestManagedResourceStorage:
[junit4] > 1) Thread[id=7702, name=Thread-2991, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] > at java.lang.Object.wait(Native Method)
[junit4] > at java.lang.Object.wait(Object.java:502)
[junit4] > at org.apache.solr.core.CloserThread.run(CoreContainer.java:894)
[junit4] > 2) Thread[id=7704, name=coreZkRegister-4177-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 3) Thread[id=7701, name=searcherExecutor-4183-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 4) Thread[id=7697, name=Thread-2990, state=TIMED_WAITING, group=Overseer state updater.]
[junit4] > at java.lang.Object.wait(Native Method)
[junit4] > at org.apache.solr.cloud.DistributedQueue$LatchChildWatcher.await(DistributedQueue.java:266)
[junit4] > at org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQueue.java:309)
[junit4] > at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:582)
[junit4] > at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:560)
[junit4] > at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:217)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([F23C49693D060B40]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=7702, name=Thread-2991, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] > at java.lang.Object.wait(Native Method)
[junit4] > at java.lang.Object.wait(Object.java:502)
[junit4] > at org.apache.solr.core.CloserThread.run(CoreContainer.java:894)
[junit4] > 2) Thread[id=7704, name=coreZkRegister-4177-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 3) Thread[id=7701, name=searcherExecutor-4183-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([F23C49693D060B40]:0)
[junit4] Completed on J0 in 36.12s, 2 tests, 3 errors <<< FAILURES!
[...truncated 105 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:474: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:454: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1298: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:922: There were test failures: 421 suites, 1761 tests, 3 suite-level errors, 2 errors, 171 ignored (18 assumptions)
Total time: 93 minutes 29 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_11 -server -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_65) - Build #
10986 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10986/
Java: 32bit/jdk1.7.0_65 -client -XX:+UseParallelGC
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.rest.TestManagedResourceStorage
Error Message:
SolrCore.getOpenCount()==2
Stack Trace:
java.lang.RuntimeException: SolrCore.getOpenCount()==2
at __randomizedtesting.SeedInfo.seed([17AD568B034D229A]:0)
at org.apache.solr.util.TestHarness.close(TestHarness.java:332)
at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:630)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:181)
at sun.reflect.GeneratedMethodAccessor28.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:790)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.rest.TestManagedResourceStorage
Error Message:
4 threads leaked from SUITE scope at org.apache.solr.rest.TestManagedResourceStorage: 1) Thread[id=2688, name=Thread-1200, state=TIMED_WAITING, group=Overseer state updater.] at java.lang.Object.wait(Native Method) at org.apache.solr.cloud.DistributedQueue$LatchChildWatcher.await(DistributedQueue.java:266) at org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQueue.java:309) at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:582) at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:560) at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:217) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=2695, name=coreZkRegister-1650-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 3) Thread[id=2692, name=searcherExecutor-1656-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 4) Thread[id=2693, name=Thread-1201, state=WAITING, group=TGRP-TestManagedResourceStorage] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:503) at org.apache.solr.core.CloserThread.run(CoreContainer.java:894)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE scope at org.apache.solr.rest.TestManagedResourceStorage:
1) Thread[id=2688, name=Thread-1200, state=TIMED_WAITING, group=Overseer state updater.]
at java.lang.Object.wait(Native Method)
at org.apache.solr.cloud.DistributedQueue$LatchChildWatcher.await(DistributedQueue.java:266)
at org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQueue.java:309)
at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:582)
at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:560)
at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:217)
at java.lang.Thread.run(Thread.java:745)
2) Thread[id=2695, name=coreZkRegister-1650-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
3) Thread[id=2692, name=searcherExecutor-1656-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
4) Thread[id=2693, name=Thread-1201, state=WAITING, group=TGRP-TestManagedResourceStorage]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:503)
at org.apache.solr.core.CloserThread.run(CoreContainer.java:894)
at __randomizedtesting.SeedInfo.seed([17AD568B034D229A]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.rest.TestManagedResourceStorage
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=2695, name=coreZkRegister-1650-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=2692, name=searcherExecutor-1656-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 3) Thread[id=2693, name=Thread-1201, state=WAITING, group=TGRP-TestManagedResourceStorage] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:503) at org.apache.solr.core.CloserThread.run(CoreContainer.java:894)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=2695, name=coreZkRegister-1650-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2) Thread[id=2692, name=searcherExecutor-1656-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
3) Thread[id=2693, name=Thread-1201, state=WAITING, group=TGRP-TestManagedResourceStorage]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:503)
at org.apache.solr.core.CloserThread.run(CoreContainer.java:894)
at __randomizedtesting.SeedInfo.seed([17AD568B034D229A]:0)
Build Log:
[...truncated 11135 lines...]
[junit4] Suite: org.apache.solr.rest.TestManagedResourceStorage
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-17AD568B034D229A-001/init-core-data-001
[junit4] 2> 887598 T2674 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 887598 T2674 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 887599 T2675 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 887699 T2674 oasc.ZkTestServer.run start zk server on port:32774
[junit4] 2> 887700 T2674 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 887704 T2681 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d0e0da name:ZooKeeperConnection Watcher:127.0.0.1:32774 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 887705 T2674 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 887705 T2674 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 887711 T2674 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 887713 T2683 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d33e31 name:ZooKeeperConnection Watcher:127.0.0.1:32774/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 887713 T2674 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 887714 T2674 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 887718 T2674 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 887721 T2674 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 887724 T2674 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 887728 T2674 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 887729 T2674 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 887735 T2674 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 887736 T2674 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 887740 T2674 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 887741 T2674 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 887745 T2674 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 887745 T2674 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 887749 T2674 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 887750 T2674 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 887754 T2674 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 887754 T2674 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 887758 T2674 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 887759 T2674 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 887763 T2674 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 887763 T2674 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 887767 T2674 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 887768 T2674 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 887772 T2674 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 887773 T2674 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 887776 T2674 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 887777 T2674 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 887782 T2674 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 887783 T2674 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/'
[junit4] 2> 887784 T2674 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
[junit4] 2> 887785 T2674 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
[junit4] 2> 887785 T2674 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/lib/README' to classloader
[junit4] 2> 887837 T2674 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 887881 T2674 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 887882 T2674 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 887889 T2674 oass.IndexSchema.readSchema [null] Schema name=test
[junit4] 2> 888309 T2674 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 888315 T2674 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 888317 T2674 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 888321 T2674 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 888324 T2674 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 888326 T2674 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 888326 T2674 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 888327 T2674 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 888327 T2674 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 888327 T2674 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 888328 T2674 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 888328 T2674 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 888328 T2674 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr
[junit4] 2> 888328 T2674 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/'
[junit4] 2> 888363 T2674 oasc.CoreContainer.<init> New CoreContainer 19490732
[junit4] 2> 888363 T2674 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/]
[junit4] 2> 888364 T2674 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 888364 T2674 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 888364 T2674 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 888365 T2674 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 888365 T2674 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 888365 T2674 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 888365 T2674 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 888365 T2674 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 888366 T2674 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 888367 T2674 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=false
[junit4] 2> 888368 T2674 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 888368 T2674 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 888368 T2674 oasc.CoreContainer.load Host Name:
[junit4] 2> 888368 T2674 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:32774/solr
[junit4] 2> 888369 T2674 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 888369 T2674 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 888371 T2685 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5ce57f name:ZooKeeperConnection Watcher:127.0.0.1:32774 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 888371 T2674 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 888373 T2674 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 888374 T2687 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1adaee0 name:ZooKeeperConnection Watcher:127.0.0.1:32774/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 888374 T2674 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 888376 T2674 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 888379 T2674 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 888381 T2674 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 888382 T2674 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 888384 T2674 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 888386 T2674 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 888387 T2674 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/188.138.97.18:_
[junit4] 2> 888388 T2674 oascc.SolrZkClient.makePath makePath: /live_nodes/188.138.97.18:_
[junit4] 2> 888390 T2674 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 888391 T2674 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 888393 T2674 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 188.138.97.18:_
[junit4] 2> 888393 T2674 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 888394 T2674 oasc.Overseer.start Overseer (id=92248005265719299-188.138.97.18:_-n_0000000000) starting
[junit4] 2> 888396 T2674 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 888406 T2689 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 888406 T2674 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 888410 T2674 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 888412 T2674 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 888416 T2688 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 888420 T2690 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 888421 T2690 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 888422 T2690 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 888422 T2691 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 888426 T2688 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 888427 T2688 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://188.138.97.18:",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"188.138.97.18:_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":null,
[junit4] 2> "core_node_name":"188.138.97.18:__collection1"}
[junit4] 2> 888431 T2691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 889423 T2690 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 889424 T2690 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 889424 T2690 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 889425 T2690 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 889425 T2690 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/'
[junit4] 2> 889426 T2690 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
[junit4] 2> 889426 T2690 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
[junit4] 2> 889426 T2690 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/lib/README' to classloader
[junit4] 2> 889472 T2690 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 889517 T2690 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 889519 T2690 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 889527 T2690 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 889774 T2690 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 889779 T2690 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 889781 T2690 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 889790 T2690 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 889793 T2690 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 889795 T2690 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 889796 T2690 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 889796 T2690 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 889796 T2690 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 889797 T2690 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 889797 T2690 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 889797 T2690 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 889798 T2690 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 889798 T2690 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-17AD568B034D229A-001/init-core-data-001/
[junit4] 2> 889798 T2690 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@17da81e
[junit4] 2> 889799 T2690 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-17AD568B034D229A-001/init-core-data-001
[junit4] 2> 889799 T2690 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-17AD568B034D229A-001/init-core-data-001/index/
[junit4] 2> 889799 T2690 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-17AD568B034D229A-001/init-core-data-001/index' doesn't exist. Creating new index...
[junit4] 2> 889799 T2690 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-17AD568B034D229A-001/init-core-data-001/index
[junit4] 2> 889800 T2690 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=30, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5596039954991283]
[junit4] 2> 889800 T2690 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@a61b09 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@9fbdfa)),segFN=segments_1,generation=1}
[junit4] 2> 889801 T2690 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 889801 T2690 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4] 2> 889804 T2690 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 889804 T2690 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 889804 T2690 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 889805 T2690 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 889805 T2690 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 889805 T2690 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 889805 T2690 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
[junit4] 2> 889806 T2690 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4] 2> 889806 T2690 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 889806 T2690 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 889806 T2690 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 889807 T2690 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 889807 T2690 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 889807 T2690 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 889808 T2690 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 889808 T2690 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 889808 T2690 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 889809 T2690 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 889809 T2690 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 889809 T2690 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 889810 T2690 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4] 2> 889810 T2690 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4] 2> 889810 T2690 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 889811 T2690 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 889811 T2690 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 889812 T2690 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 889812 T2690 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 889812 T2690 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 889813 T2690 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 889813 T2690 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 889813 T2690 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 889813 T2690 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 889814 T2690 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 889814 T2690 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 889815 T2690 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 889815 T2690 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 889815 T2690 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 889816 T2690 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 889816 T2690 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4] 2> 889817 T2690 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4] 2> 889820 T2690 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 889821 T2690 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 889822 T2690 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 889823 T2690 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 889824 T2690 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 889825 T2690 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4] 2> 889827 T2690 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 889827 T2690 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 889828 T2690 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=39.6904296875, floorSegmentMB=2.1748046875, forceMergeDeletesPctAllowed=3.785280289845736, segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 889828 T2690 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@a61b09 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@9fbdfa)),segFN=segments_1,generation=1}
[junit4] 2> 889828 T2690 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 889829 T2690 oass.SolrIndexSearcher.<init> Opening Searcher@1408083[collection1] main
[junit4] 2> 889829 T2690 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 889830 T2690 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 889830 T2690 oasr.RestManager.init Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
[junit4] 2> 889830 T2690 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
[junit4] 2> 889830 T2690 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 889831 T2690 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
[junit4] 2> 889831 T2690 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 889831 T2690 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4] 2> 890025 T2690 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 890044 T2692 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1408083[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 890050 T2690 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 890051 T2695 oasc.ZkController.register Register replica - core:collection1 address:http://188.138.97.18: collection:collection1 shard:shard1
[junit4] 2> 890052 T2695 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 890053 T2674 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 890058 T2695 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 890058 T2674 oas.SolrTestCaseJ4.setUp ###Starting testFileBasedJsonStorage
[junit4] 2> 890059 T2674 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-17AD568B034D229A-001/json-storage-001/'
[junit4] 2> 890059 T2691 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 890060 T2695 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 890060 T2695 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 890060 T2695 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://188.138.97.18:/collection1/ shard1
[junit4] 2> 890060 T2695 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 890061 T2688 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 890063 T2691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 890065 T2688 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 890067 T2691 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 890068 T2691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 890077 T2674 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-17AD568B034D229A-001/json-storage-001/managed
[junit4] 2> 890078 T2674 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _test_foo.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-17AD568B034D229A-001/json-storage-001/managed
[junit4] 2> 890078 T2674 oasr.ManagedResourceStorage.load Reading _test_foo.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-17AD568B034D229A-001/json-storage-001/managed
[junit4] 2> 890078 T2674 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _test_foo.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-17AD568B034D229A-001/json-storage-001/managed
[junit4] 2> 890079 T2674 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _test_foo.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-17AD568B034D229A-001/json-storage-001/managed
[junit4] 2> 890079 T2674 oasr.ManagedResourceStorage.load Reading _test_foo.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-17AD568B034D229A-001/json-storage-001/managed
[junit4] 2> 890080 T2674 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _test_foo.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-17AD568B034D229A-001/json-storage-001/managed
[junit4] 2> 890080 T2674 oas.SolrTestCaseJ4.tearDown ###Ending testFileBasedJsonStorage
[junit4] 2> 890085 T2674 oas.SolrTestCaseJ4.setUp ###Starting testZkBasedJsonStorage
[junit4] 2> 890085 T2674 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './'
[junit4] 2> 890096 T2674 oascc.SolrZkClient.makePath makePath: /test
[junit4] 2> 890097 T2674 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /test
[junit4] 2> 890098 T2674 oascc.SolrZkClient.makePath makePath: /test/_test_foo.json
[junit4] 2> 890099 T2674 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 136 bytes to new znode /test/_test_foo.json
[junit4] 2> 890100 T2674 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _test_foo.json using ZooKeeperStorageIO:path=/test
[junit4] 2> 890100 T2674 oasr.ManagedResourceStorage.load Reading _test_foo.json using ZooKeeperStorageIO:path=/test
[junit4] 2> 890101 T2674 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 136 bytes from znode /test/_test_foo.json
[junit4] 2> 890101 T2674 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _test_foo.json using ZooKeeperStorageIO:path=/test
[junit4] 2> 890102 T2674 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 175 bytes to existing znode /test/_test_foo.json
[junit4] 2> 890102 T2674 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _test_foo.json using ZooKeeperStorageIO:path=/test
[junit4] 2> 890102 T2674 oasr.ManagedResourceStorage.load Reading _test_foo.json using ZooKeeperStorageIO:path=/test
[junit4] 2> 890103 T2674 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 175 bytes from znode /test/_test_foo.json
[junit4] 2> 890103 T2674 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _test_foo.json using ZooKeeperStorageIO:path=/test
[junit4] 2> 890104 T2691 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 890104 T2674 oas.SolrTestCaseJ4.tearDown ###Ending testZkBasedJsonStorage
[junit4] 2> 890106 T2674 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:32774 32774
[junit4] 2> 890115 T2695 oasc.ZkController.register We are http://188.138.97.18:/collection1/ and leader is http://188.138.97.18:/collection1/
[junit4] 2> 890410 T2689 oasc.OverseerCollectionProcessor.amILeader org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.amILeader(OverseerCollectionProcessor.java:514)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:269)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 890817 T2675 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:32774 32774
[junit4] 2> 890817 T2695 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://188.138.97.18:
[junit4] 2> 890818 T2689 oasc.OverseerCollectionProcessor.amILeader According to ZK I (id=92248005265719299-188.138.97.18:_-n_0000000000) am no longer a leader.
[junit4] 2> 890819 T2695 oasc.ZkController.checkRecovery WARN Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4] 2> 890819 T2674 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 890820 T2695 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 890820 T2695 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 890820 T2695 oasc.ZkController.getLeaderInitiatedRecoveryState WARN Unable to read /collections/collection1/leader_initiated_recovery/shard1/188.138.97.18:__collection1 due to: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_initiated_recovery/shard1/188.138.97.18:__collection1
[junit4] 2> 890821 T2695 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 890821 T2695 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 890821 T2695 oasc.ZkContainer$2.run ERROR org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:268)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:265)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:265)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.createData(DistributedQueue.java:369)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:353)
[junit4] 2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:1092)
[junit4] 2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:1029)
[junit4] 2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:1025)
[junit4] 2> at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:207)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 890822 T2695 oasc.SolrException.log ERROR :org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:268)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:265)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:265)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.createData(DistributedQueue.java:369)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:353)
[junit4] 2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:1092)
[junit4] 2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:1029)
[junit4] 2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:1025)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:840)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:754)
[junit4] 2> at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:200)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 3546 T2673 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 4 leaked thread(s).
[junit4] 2> 23697 T2673 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 4 threads leaked from SUITE scope at org.apache.solr.rest.TestManagedResourceStorage:
[junit4] 2> 1) Thread[id=2688, name=Thread-1200, state=TIMED_WAITING, group=Overseer state updater.]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue$LatchChildWatcher.await(DistributedQueue.java:266)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQueue.java:309)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:582)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:560)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:217)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 2) Thread[id=2695, name=coreZkRegister-1650-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 3) Thread[id=2692, name=searcherExecutor-1656-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 4) Thread[id=2693, name=Thread-1201, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Object.wait(Object.java:503)
[junit4] 2> at org.apache.solr.core.CloserThread.run(CoreContainer.java:894)
[junit4] 2> 23698 T2673 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=2688, name=Thread-1200, state=TIMED_WAITING, group=Overseer state updater.]
[junit4] 2> 2) Thread[id=2695, name=coreZkRegister-1650-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] 2> 3) Thread[id=2692, name=searcherExecutor-1656-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] 2> 4) Thread[id=2693, name=Thread-1201, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] 2> 911297 T2688 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 188.138.97.18:_
[junit4] 2> 911298 T2696 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 26717 T2673 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=2695, name=coreZkRegister-1650-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 2) Thread[id=2692, name=searcherExecutor-1656-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 3) Thread[id=2693, name=Thread-1201, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Object.wait(Object.java:503)
[junit4] 2> at org.apache.solr.core.CloserThread.run(CoreContainer.java:894)
[junit4] 2> NOTE: test params are: codec=Lucene49: {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=fr_CA, timezone=Asia/Riyadh
[junit4] 2> NOTE: Linux 3.13.0-32-generic i386/Oracle Corporation 1.7.0_65 (32-bit)/cpus=8,threads=4,free=128981944,total=269484032
[junit4] 2> NOTE: All tests run in this JVM: [AnalyticsMergeStrategyTest, SpellingQueryConverterTest, ZkNodePropsTest, SolrCoreCheckLockOnStartupTest, ShowFileRequestHandlerTest, HdfsWriteToMultipleCollectionsTest, IndexBasedSpellCheckerTest, ParsingFieldUpdateProcessorsTest, HdfsBasicDistributedZk2Test, TestBinaryResponseWriter, StandardRequestHandlerTest, TestReplicationHandlerBackup, HighlighterMaxOffsetTest, MinimalSchemaTest, TestDocSet, LeaderElectionTest, TestSuggestSpellingConverter, DocValuesMultiTest, TestSolrXmlPersistence, TestReplicationHandler, TestLRUCache, TestLMJelinekMercerSimilarityFactory, TestFastOutputStream, SuggesterTest, TestFuzzyAnalyzedSuggestions, TestPartialUpdateDeduplication, TestSolrDeletionPolicy2, CursorMarkTest, DistributedDebugComponentTest, TestFastLRUCache, TestLuceneMatchVersion, ReturnFieldsTest, SolrXmlInZkTest, CoreAdminHandlerTest, TestFieldTypeCollectionResource, BasicFunctionalityTest, SSLMigrationTest, UpdateParamsTest, TestSolrXml, TestCloudManagedSchemaConcurrent, BasicDistributedZkTest, FieldMutatingUpdateProcessorTest, TestFileDictionaryLookup, TestLeaderElectionZkExpiry, SimpleFacetsTest, TestInitQParser, ZkControllerTest, TestCollationFieldDocValues, HighlighterTest, AddBlockUpdateTest, DocExpirationUpdateProcessorFactoryTest, TestQuerySenderListener, ExpressionTest, PathHierarchyTokenizerFactoryTest, TestClassNameShortening, TestDistributedSearch, TestStressVersions, OverseerCollectionProcessorTest, TestSearchPerf, AnalyticsQueryTest, JSONWriterTest, ChangedSchemaMergeTest, TestSolrJ, CoreAdminRequestStatusTest, XsltUpdateRequestHandlerTest, NotRequiredUniqueKeyTest, TestStandardQParsers, TestChildDocTransformer, MBeansHandlerTest, TestJmxIntegration, QueryEqualityTest, FastVectorHighlighterTest, AssignTest, TestComplexPhraseQParserPlugin, FieldFacetTest, TestCustomSort, TestArbitraryIndexDir, TestFieldTypeResource, TestMissingGroups, OverseerStatusTest, DOMUtilTest, TestSchemaSimilarityResource, AbstractAnalyticsFacetTest, SpellCheckComponentTest, SpellCheckCollatorTest, TestRTGBase, TestManagedResourceStorage]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestManagedResourceStorage -Dtests.seed=17AD568B034D229A -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr_CA -Dtests.timezone=Asia/Riyadh -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | TestManagedResourceStorage (suite) <<<
[junit4] > Throwable #1: java.lang.RuntimeException: SolrCore.getOpenCount()==2
[junit4] > at __randomizedtesting.SeedInfo.seed([17AD568B034D229A]:0)
[junit4] > at org.apache.solr.util.TestHarness.close(TestHarness.java:332)
[junit4] > at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:630)
[junit4] > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:181)
[junit4] > at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE scope at org.apache.solr.rest.TestManagedResourceStorage:
[junit4] > 1) Thread[id=2688, name=Thread-1200, state=TIMED_WAITING, group=Overseer state updater.]
[junit4] > at java.lang.Object.wait(Native Method)
[junit4] > at org.apache.solr.cloud.DistributedQueue$LatchChildWatcher.await(DistributedQueue.java:266)
[junit4] > at org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQueue.java:309)
[junit4] > at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:582)
[junit4] > at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:560)
[junit4] > at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:217)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 2) Thread[id=2695, name=coreZkRegister-1650-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 3) Thread[id=2692, name=searcherExecutor-1656-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 4) Thread[id=2693, name=Thread-1201, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] > at java.lang.Object.wait(Native Method)
[junit4] > at java.lang.Object.wait(Object.java:503)
[junit4] > at org.apache.solr.core.CloserThread.run(CoreContainer.java:894)
[junit4] > at __randomizedtesting.SeedInfo.seed([17AD568B034D229A]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=2695, name=coreZkRegister-1650-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 2) Thread[id=2692, name=searcherExecutor-1656-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 3) Thread[id=2693, name=Thread-1201, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] > at java.lang.Object.wait(Native Method)
[junit4] > at java.lang.Object.wait(Object.java:503)
[junit4] > at org.apache.solr.core.CloserThread.run(CoreContainer.java:894)
[junit4] > at __randomizedtesting.SeedInfo.seed([17AD568B034D229A]:0)
[junit4] Completed on J0 in 26.79s, 2 tests, 3 errors <<< FAILURES!
[...truncated 899 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:474: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:454: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1298: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:922: There were test failures: 421 suites, 1761 tests, 3 suite-level errors, 822 ignored (16 assumptions)
Total time: 73 minutes 52 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.7.0_65 -client -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_11) - Build #
10985 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10985/
Java: 32bit/jdk1.8.0_11 -client -XX:+UseG1GC
1 tests failed.
REGRESSION: org.apache.lucene.analysis.icu.TestICUNormalizer2CharFilter.testRandomStrings
Error Message:
startOffset 578 expected:<2788> but was:<2789>
Stack Trace:
java.lang.AssertionError: startOffset 578 expected:<2788> but was:<2789>
at __randomizedtesting.SeedInfo.seed([5E387E8519AB4711:D6B17E3BBAAF1024]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:183)
at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:296)
at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:300)
at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkAnalysisConsistency(BaseTokenStreamTestCase.java:860)
at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:615)
at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:513)
at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:437)
at org.apache.lucene.analysis.icu.TestICUNormalizer2CharFilter.testRandomStrings(TestICUNormalizer2CharFilter.java:189)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 6267 lines...]
[junit4] Suite: org.apache.lucene.analysis.icu.TestICUNormalizer2CharFilter
[junit4] 2> TEST FAIL: useCharFilter=false text='\u174b\u1744 t \u25cc\u25b6\u25d6\u25cb\u25e9\u25db\u25fc\u25d0\u25ce \uf72e\ud82e\ude59 ebbv ow \u20d9\u20eb\u20d3\u20d1 ci shnl \u1387\u139e\u1388\u1392\u1383 \u2946 \udbf8\udedd\u274a qatmz -- il- \u260a\u265d sfctyxq \uada85\ud857\udc0e ioii fu \u235d\u2303 M\u013f\ufb40\ue719\uebc5c hnyzbis <Fh h| \ua4ee\ua4e0 v \ud83c\udd38\ud83c\udde3\ud83c\udd5b\ud83c\udd98 ddlhe \u05f1 j j tirg \uf5fe\ue642\ue718\u00bc gwifj t\ud938\udf01 fd \ue948\u296d\ud953\udfaa\ue584E\u368f yidx \u1582 \u06b8\u2da2\uaca6 \u02ea\u0009\ue68f\u76ad\uc6a3 q kw sg xtsx \ua1f7\uf25b\u00ea xk asriud dhzj ro \u17f1\u17d0\u17ac\u1780 \ufef5\u8e13\ud9ab\ude48\u06a5\u0000 unxq \ud87e\udc99 \u8370\udb10\ude82\u050e\ue008 tq qm 4299 utu ndn v fekd twurrn slk H n \ua70c\ua701\ua704 vagbr br <?\\\"</ dshbap wyxzdf \u0568\u056b\u058a omzrwrd \u2ffd\u2ffb [ evr gowka punjr wpckb \udbc5\udcaa\u0410[^ vdwe \udb56\udf28\uf873 bqu xf \ua807\ua829\ua81d\ua804\ua802\ua80a\ua82f\ua825 \u2431\u240a\u241c\u240b\u243f\u240f \ufb34 gq- \ud904\ude90\u0696\u3afe\ue9cf\udad1\ude5f\ue4aeb xb \ufe3b\ufe39\ufe40\ufe45\ufe3c\ufe33\ufe36\ufe3c\ufe39\ufe48 pmshnqhbiavu fymX dhu vuqlxv g gwm ]cp] ~ xvy \ud802\udd30\ud802\udd2d \u0003\ufb52 ohldWN (dee|mhj qr ady \u1c2e\u1c18 yqwgbm vvf kgnmx \ud803\udc1b\ud803\udc11 vogjy \u1963 \u0407\uf9625 \u0e83\u0ece\u0ebd\u0ec3 l \u1908 \u2e9d\u2eff\u2ef1\u2ef1\u2ef4 ckl qlphx \u1159\u11e1\u118b\u1197\u113f\u11c5\u1151\u11d0\u1113\u118e\u115f q g \ud879\udea2\uef11z\ud918\ude4f \u29f1\u29db dopdq qdxu bi rjd e -- cky \u06b8\u016f\ueefc \u0194\u8c51\ufe28 \ua4af\ua4a9\ua491 {1, \u2d88\uebd9 kixne g \u1630 q \u2d8c \u001f\uffe3\u05deb\u0336\u00dc\udb65\udd0b objg axd x \u1d82\u1d99\u1da6\u1da5 n \u1daf\u1d91 npnyvwc szd ejufxp \ue882\u0e6a\udaf6\udfac\uea49\u0449\uda44\uddac\uab9b\uee1f ;< \ud8fc\udd0ab\ued86\u053b gsfrwfbi \ua582\ua5e5 } \ufe44\ufe3d\ufe44 \u0c89\u0cd3\u0ce7\u0ca9\u0cf0\u0caf\u0ce6\u0ca1 [|x]lv \ud862\udcc6\ud84d\udf30 bzfdge ma spn <!--< \u27f9\u27f3\u27fe\u27fc\u27f5\u27f2 e-pz \uabf9\uabed\uabe3\uabc6 inp \uff94\uff82\uffca\uff91\uff2a \u0443\udb8c\udf62\uda8b\udf27\u4125\u0716 \uda58\udf58\uf047\u08d2H rdpmfl \u055a ;-- \u07ed7\ud893\udf71 yz is pbuc h yuy gxn hhb \ud802\udf02 rtcrr ; \u0d21\u0d64 \uaa4a gnhacvzq hgefnv xsnmsm lqkjp nrenmfhw \u2438\u2412\u2439\u2432 xjso \ue582\u0426\u8678\uaf89X\u2336 \uffff\ufff7\ufffe qspuxdw )]bbez \u92baL\u1f22\u2947\ue46f\uea79\u0012 \u0332\u49e2\u0614I [)j?iu \ud803\ude69\ud803\ude67\ud803\ude7f wr \ucf12 \u00bd\uf9a44 \ua78f\u00f7\u0012 yowte \ua90a \u2284\u22cd\u2286\u229e\u2284\u22f8\u2233 \u2a6c\u2a6c\u2a91\u2ad1\u2a65\u2ab9 \ud91c\udfba\ue5e1\u0186 gzuca \u2ef1 \u0015 eyi \u2a8e\u2a20\u2ac5\u2a8a\u2a53 ydlrketk \u1ce4\u1cf7 twt c\ue155 e \u25e7\u25ce\u25b8 bmo \u086dF\u36b7 [{1,5}f \u2ff4\u2ff8\u2ffd \u2e3a\u2e26\u2e19 unz vg no vq gz KSPseSD aczg s \ubcfc\udaca\udf27 {0,5}q \ud834\udddd\ud834\uddfd\ud834\udd19\ud834\udd15\ud834\udd82 s \u16de\u16e4\u16dc\u16b5\u16a7\u16a3 \u000b\ue06d {1,5 dgtvnmzog \u26a7\u2604 o \u0aa2\u0ae1\u0aff\u0a85\u0ad8 gl \ua9b0\ua98c zdji \u2d85\u2dbf\u2d90\u2dc9\u2dbc\u2dcd\u2d81\u2ddf\u2d94 .q \ua6db\ua6e1\ua6fd\ua6ed cccmz \ua8f6\ua8f1 ywm \u04bb\ue974\u018c\u9f15 \u3120\u312b\u310e\u3123\u3120 \u1979\u1952\u196e\u1963\u197e \ufcca\uda95\udc6e\ud9c4\udf1a k \uf285\u035d umb lg kfc hao \u1724\u1729\u172f \u101b\u108e\u105d\u1080\u1039 wsjoj \ud800\udc13\ud800\udc47\ud800\udc7a o zq o)nd xm \u25d2\u25bd\u25b0 \u07f3 zldbm efh wkftnvx \u1962\u195e\u195b\u1978\u1966\u1971\u1960\u196d\u1977 \" \ud83c\udc02\ud83c\udc25 \ud800\udf9c\ud800\udf80 \u119e\u110b\u112f\u11a8\u1192\u111e\u1194\u11ef\u11ce\u1103 \udb64\ude4d\u0085 \u02c5\u02d3\u02c5 zv \uff23\\\u0302O\u055a\ue8fb* \u0cb1\u0cd6\u0c9b\u0cb4\u0c9b\u0cea\u0cc8 \u0751\u077f\u077f\u0776\u077a .i[d gfh \ud8d3\udc69\ue685( puxvmemt qtbs ces \u02b5\u02ea d \u001f dvkbnc \u0b0e /I\u0770 \ud801\udc30\ud801\udc21\ud801\udc3d Yz \ud87e\udc9c\ud87e\udc04 \u0324\u016a \ud800\udd1b\ud800\udd2c yzfkc omzlaiwrt lqds { hws drt \u0420\ue9c5 A\u02be bfvrm uqs WWGzWxx \u2c22\u2c2f\u2c11\u2c4f </ wakpw sfxlk \u051f \u2c68\u2c7c\u2c60 \u01f3\u01a0 \ud83c\udc1c \ub39d\uf82f xim [{0, afu b rz eqjs \u0655 \ua8c4\ua8c0 emly wmb vt mve \u03b9p\u075b6\u034b iNbdhce -\u0100 \u01b0 znvd \u0a1e\u00c0!\u07e7\u06c2 abrln aj \u0e60\u0e14\u0e44\u0e4c txh pw \u0f96\u0f4d zhm hhgjm \u31fd\u31fe\u31fc fd t bigxg \u6dff~\u00e3\u0820 \u6012k\udb6e\udc9f mvdvhwc mh \u1b83\u1b9c \ue5c0 \u020e\u020c\u01dd\u01c2\u01d0 bynoirp \u024c tu n decpg mvg w lgcceu \udb3e\udf12D\u0460\u0400 fxw lwzt xd sm pxpocfljhpc \ufe08\ufe02 mrkcq apg pucuvkgz ondx < ; \ua716\ua717\ua70e\ua70e\ua70c \n\"<ojkc #\ubf2d\ue723E \ubf5a\ue424 qj dwlisosiw \ua977 ² cyyt \ud8d2\uddd1\u6acc \ud9a9\udcf0\u000f\u655d jkw ct o \ufc5a\ud86c\udf78\u02d8 lais \ud800\udf3f xt syydlmrsy \u1809\u183d\u18a7 nHNnrwpzvg \u0a7a\u0a0d\u0a27\u0a42\u0a72\u0a2f\u0a6a \u0018\u9d42 \u06cb\u0578t \ua7d9\ua769\ua7d8 \u6466 \ud808\udfa4 }\uf9a3\ue649\u00a9\u43f2\u0013\u1b05 v zqbx \u07ac\u0791\u079f\u07aa il[(ojkf)k- </p> d NKxFF qm \u6473\u04f6 jjlq \u0967 qas \ufe14\ufe1c \u06ac\uf00dA \n \ud800\udf9c j h \u1469\u162f st{1 maga ade zc q \u064eKB\uaaa5 \u31f9 \ufe63\ufe51\ufe63\ufe58\ufe5f\ufe68\ufe5a\ufe6d \u2042 p\ued66\u8751 wl \u1c0c\u1c4b\u1c17\u1c31 \u2ffd\u2ffa\u2ffe \u0d93\u0dc0 \ud800\udd9a \u1b6a\u1b3e\u1b72\u1b3f \u07f4\u07eb \uf4f1\ub5e7 \u6728 yobfpn ezwz \uabdd\uabe9\uabcd\uabd4\uabcb \ue269\uff65\u0609\u2be5 p 7\u047b\u9f75 rq aue \ud998\udf83\uda52\udfb9\u01ae vxbvh qpi \uf32e\u766b\ud8bc\udcdcQ\u52a7 v wvk dz \u0458\u0485 xy c g uq dgrd othftwz \ua965 \u0005 \u20c5\u20bc\u20ca\u20ac\u20ca\u20c6 \ud847\udfbd\ud90e\udcd6\u0006\ue547\ubd2a vz mg u{ zxezdzrs ip sztk \u1b6b\u1b19\u1b78 \u00f5\u86c7\uda28\uddc3\u0118! heckfsvdp p tyzkk </gnf b bsnghm qXS e\ufd78\u6b53\uedf4\ud8d6\udc29 wJ s ga ;< \u05f7 </Br> ktqnjkp \ud800\udf86 \u11a8\u11f9\u111c txfrixi \uf36f xl \ufff6\ufffb\uffff\ufff9\ufff7\ufff6 sdavj [fqzpg{1 bla kvenje uc \u010c\u0003\u0233\ud9e9\udc6f\u0416 vp ronto \\'? hxxj L\u06bf wkg b \u24ea\u24f0\u24a9 xbxt \u208b\u208d\u2091\u2072\u2082\u2097\u2072 \"&#x ala |e\ud93b\udcee\u07a1\ue5f5 ke \ua8e7\ua8fc\ua8f4\ua8ec\ua8e6\ua8e7 \ud834\udf7e \u0450\ueafa\ud8c2\udee9\uafa6 q?re?.h \u000f jQk nkyei oymvp c { \u031dx\ue7e3 ss i nic \u2e36\u2e7d\u2e58\u2e5f \ua83d\ua83f\ua83f\ua837\ua837 \u2185\u2182\u2157\u2155\u2176 by vu \u18fe\udada\udebf\udaaf\udea6\u03c1 \u001b3\uf139 r \u07d8\ud9f0\udc34\u0272\u0148\uf038\ud84c\udc47 \u0000t=\u0283\u0384 go tdyoid \"5 un hGv q t {0,5} \ud8a2\udf0d\udb3d\udc96 \u0165f q \u001a\u620f\ufa2c q M\u4711\u599d \ueec7\uec78u\ue923 yjtcsoez wlui u{ \uf336\uf364\u07ca 1 \u031d\u036a\u036a\u0344 \u6944 asC \u0f75\u0fb1\u0f9b\u0f45\u0f33 \u208c\u208f\u2097\u2094 \ufb1c \u18f5\u0645\u07a1 \ud800\udc20 ossofy uz pgmr u iiw \u2277 wpbb oe \ud802\udf70 apg wluaz [jmx{ rt cxmu \ud802\udc28\ud802\udc18 \u1ced\u1cf6\u1cd4\u1cd3\u1cdd\u1cd7 gkhzghnj wqz \ua70a\ua70f\ua706\ua707\ua700\ua71f\ua700\ua710\ua70d\ua702 \u4d30\u4913\u48ab\u3a91\u4bc8 f\u0669\ud89e\udf74\u07f1\ue57d\u073f \u2343 W\u01e2\ud8d4\udc81J} \u0221B\ue898 \ufb32 by -->< oabmv \ue2f7\u077b\ue682\ueee7 \u94a6E zglvowhol \ud800\udf4a\ud800\udf44 fx \u27dc e\u8e78 m s\u5d54\u1aaa d{0, \u07aeD\u9d3f\u4549 \u28f4\u2865\u28f0\u28d0\u283a\u280b {0,5}n fhqmfqg essu jbpk < qqkttgq <scriP rd wphx wz \u338a\u0601\u03c1 fbrz xxb iihew w\udbf8\udf62H\rH kcYpkXqna \u6bf8\u7282d \uf1b6\ufb08\ud7d1IF \udac9\udea3\ud93f\udc039'\ua0e8 tduzx qri \u3751V sok ' ^\ud92d\udf39 \u27eb\u27ca unhkk yzud \ufe1f\ufe13 \u2169\u2157\u2160\u2181\u2161\u218d\u215d gl d \u0405\uf827\ueb2dCM~ </s \u0cee\u0cd0 dshnv \uf3c5\u0730 imdp \u1709\u1709 \u06da\u0512\u0013=\u06e3 { rimij \uda2e\udea1 ldzy nn-t r i uoufd lldboa has dkhkrqg \u0c5blj dolpk (e \u04d4\u0628\uf293\ue8c8\u0000\u01d3\u794f oof \u044d \u038e\u0373\u03e8\u03b1 <!-- wVr \u3190 \u036c\u0361\u0314\u0332\u035b\u0354 \u0eae\u0ed0\u0ebd\u0e90 ujnrat er rk u \u0185\uf10f\uea6d\ud928\udf87\u0015 \ufe80 ugymn >\u6626\u5681?( omv wrricbh \u2776\u2768\u278b\u277f\u2788\u2758\u274f hv pnozdz <Sc wdg ebbziyg ?\ud8d3\ude80 cR l]b \ued92\uda50\udc07\uf2ae\u07d9 xis \u0dd1\u0df2\u0d92\u0d9a\u0ded 6\u18e6\uf8f4 \u1dc7\u1df9\u1dec\u1dcf\u1ddf \u0daa\u0df8 \u20fa\u20d7\u20e1\u20fb \ud834\ude12\ud834\ude3a \u07d6\u07ff\u07dd\u07d0\u07e0\u07f9\u07ec </ \u0014\ud86b\udc20 ul hernzh } \u01e3\u033c, \ud877\udd1d \ufaf8 zh lyaxr \ub9a9\u12d5 \u039c\udbc5\ude54 (\u00ac\udb14\udc0ef\ue7f3 \ua968\uf2de\n\u0227 i\u041c \ua564 \u2841\u2800 iz R mvlcrbd \udb6e\udd4b\u01ed\u0220\uf136\u00bc\uf5b8 \uff59\u07f3 \ud866\udf45 \ua8fa\ua8e9\ua8f7\ua8e8 sbgz \u173a\u172c\u172c jnzhe cyfap \u0c46\u0c4f\u0c32 \u018d\u023e\u0223\u01c1\u024c *\u4dee glrqxqx \u0019 jwqg \ud835\udf78\ud835\uddd7 \u1204\u1368\u135e \u03bc4 \u1a1e s ugfw n /\u0004\n \ud83c\udde0 < vh \\\" \ud8d6\udffb\ufb5e ||( zhp t p \u16ae\u16ae\u16bf\u16be\u16dd +\u0259\uf43cz\ufbdd\ud9eb\udd33 ud lxx \u24e3\u24d4 \ud800\udf8f\ud800\udf94 \ufe27\ufe28 \uf06f ehh \ufe66\ufe68\ufe67\ufe68\ufe67\ufe5c\ufe50\ufe53\ufe61\ufe58 \ue28d\ua112 rbla '\n< \u0439\udaf0\udd274 xt \ufe41 \u00e5\u001e\udb3e\udd3d \ud7df\ud7b4\ud7b5\ud7b9\ud7db\ud7b2\ud7dc nditfyw xak qnadp pvlyb yijzhlgl \u18fc\u18ea\u18e0\u18b2\u18fa\u18e9 u \ud1ad </ fkia hvno \ua4d3 x hekz \u1de5\u1de8\u1df1\u1ddc\u1dd0\u1de6 \u22d8\u225a\u2202\u228c nhjd l \u1c20\u1c08\u1c0d\u1c1c \u07ea\u07d0\u07d2\u07c8 \u0087\uf07cI\u53e9E\u0233 cwxbwm \u18df C(\u0478 gec ajpjxx \ua93e brkpm qiztdclh mdmdwx < v \uda68\udd4d\ub9d43* --> ceyyi \u0569\uf23e\uea08\u0005\u0010\u0411 sgjs p \ud802\udc4d o 2\ub3d7f\u4bd5 e)f \u9a28\ue220\uec21 ixfh agmose qr pzxaodl \u0006 pda \ud803\udc2e\ud803\udc1e\ud803\udc36 w \uda1d\udec1\u5d1d\ud847\udcb8 gcrju \u6413\u06fe \u26e63 -?[u-i kcraq s\udbc9\udc25\u000f lwue \ud800\uddef \u0014\u05b6\uf75c\u065d\u65fdz\uefc6\u8847\ufacd\u01b7 \u000f\u279d lcjqqk ed vxe \u6911 \ufe69\u0349\udaac\udc90 q \ud802\udc45 \ufe18\ufe15\ufe17 nrnmv av axbw e\ufc78k \u044e\u161bb ovrqs nglnk a xtui tj \u0010\u6670\ufe94 \u0a16\u0a50\u0a3f\u0a3f\u0a0e\u0a0b j \u28f4\u2893\u281b\u286f \u31c9\u31d3\u31ef\u31de\u31c1\u31c2\u31df\u31d7\u31c4 oau \udb40\udc66 xr cmbg \ua918\ua91e\ua91a\ua91a\ua911\ua917\ua90d\ua914 <!--#&# h{ \u24d8\u248b\u2499 c xnskd fqoezpo xe c mlezh kgxodopnn b f \u0c33\u0c5a\u0c04 i \udac8\udfb0\u5dbc\ueab3 yxtep \u06ab\ud901\udfb1;\u0188 xhyr &A xcae dz \ud802\udf25 \ud86a\udc60\ud869\udfa3 \ufe85\u04bd\uf3b9 \u54d3\u02b8\u0095\u00c3 qfoped \u4de2\u4df3\u4dcc\u4dc7 uekqq \ua84c\ua859\ua859\ua85b\ua852\ua84c\ua849 dohf <! amhu rov c > k\ue400 \u138f\u139a\u139a\u1382 bBm eftkyih \u06b4\u1694 uw tq)v az fks rlbc nry \u0529\u0528\u0512\u0522\u0510\u051f (a) arrz rxstdp vrphzbotu \ud802\ude08\ud802\ude1f \u2dbf\u2db0\u2dca\u2dca atq ajmq qa \"&#</b \ud80c\udf04 \ud800\udd08\ud800\udd3c jau osloesdp bdpkjm i \u033d \ud834\udf09\ud834\udf07 OA be f \udbdc\udc67\" q \u147b\u1459\u1494 !\u2849 qpzfo rat \ue1e7\udb11\udc01\u00fd\u8f51 -sbk?- q|| bd y \u2c49 \ua96a <</ llhsu pfm \ufbf7\u05b2C\uf00b\u00075J\ueaa0\ubf96 \u1a99\u1a90\u1a9e\u1a23\u1a67 bc ffpSu hykuss sba \u055fh\u00b9 \u78b2\ub6fd\ucca2\u060c\u1a45 qyg gfdca \ue128\ue647\ued47\uea8c\uf750\uf35e rldorn \ud800\udd54\ud800\udd6a \u1cf7\u1ce1\u1cda mep jlizy vskq i ipb \u016e\u0499 \u076d\u075d\u0777\u0763\u077b sz \udab7\ude15 \u06d8\u2a76\uf3f6\u0177 e g \ue5bbV\u08f9\u0625 xrfamdqzmu mztdul ?z( hoa \ua97b \u29ae\u29b5\u29f7\u29cb 3\u001e:\uc7f0 ryhixa ggj \u7fa1\u000c\u0543\ue1e6 fmpwdr \ubba7\u770f\ufac3\u062d\u0496 uzwal \u05e9'
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestICUNormalizer2CharFilter -Dtests.method=testRandomStrings -Dtests.seed=5E387E8519AB4711 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_GB -Dtests.timezone=Pacific/Tongatapu -Dtests.file.encoding=ISO-8859-1
[junit4] FAILURE 1.22s J0 | TestICUNormalizer2CharFilter.testRandomStrings <<<
[junit4] > Throwable #1: java.lang.AssertionError: startOffset 578 expected:<2788> but was:<2789>
[junit4] > at __randomizedtesting.SeedInfo.seed([5E387E8519AB4711:D6B17E3BBAAF1024]:0)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:183)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:296)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:300)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkAnalysisConsistency(BaseTokenStreamTestCase.java:860)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:615)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:513)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:437)
[junit4] > at org.apache.lucene.analysis.icu.TestICUNormalizer2CharFilter.testRandomStrings(TestICUNormalizer2CharFilter.java:189)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are: codec=Lucene49: {dummy=FSTOrd41}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=en_GB, timezone=Pacific/Tongatapu
[junit4] 2> NOTE: Linux 3.13.0-32-generic i386/Oracle Corporation 1.8.0_11 (32-bit)/cpus=8,threads=1,free=64994432,total=150994944
[junit4] 2> NOTE: All tests run in this JVM: [TestICUTransformFilterFactory, TestICUNormalizer2FilterFactory, TestICUFoldingFilterFactory, TestICUNormalizer2CharFilterFactory, TestCharArrayIterator, TestICUTokenizer, TestICUCollationKeyAnalyzer, TestWithCJKBigramFilter, TestICUTokenizerFactory, TestICUNormalizer2CharFilter]
[junit4] Completed on J0 in 12.99s, 17 tests, 1 failure <<< FAILURES!
[...truncated 10 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:474: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:454: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build.xml:544: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:2028: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/analysis/build.xml:106: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/analysis/build.xml:38: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/module-build.xml:60: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1298: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:922: There were test failures: 15 suites, 112 tests, 1 failure
Total time: 28 minutes 47 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_11 -client -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any