You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2014/01/10 07:56:26 UTC
[JENKINS] Lucene-Solr-NightlyTests-4.x - Build # 482 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-4.x/482/
3 tests failed.
REGRESSION: org.apache.solr.cloud.OverseerTest.testOverseerFailure
Error Message:
KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
Stack Trace:
org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
at __randomizedtesting.SeedInfo.seed([21D3AF3AA7A6088:615B500B8DF8FA9]:0)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:428)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:425)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:382)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:369)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:112)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:107)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:155)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:275)
at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:153)
at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:584)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
REGRESSION: org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload
Error Message:
expected:<[{indexVersion=1389336887409,generation=2,filelist=[_1t7.cfe, _1t7.cfs, _1t7.si, _2pt.cfe, _2pt.cfs, _2pt.si, _3mf.cfe, _3mf.cfs, _3mf.si, _4j1.cfe, _4j1.cfs, _4j1.si, _5fn.cfe, _5fn.cfs, _5fn.si, _6c9.cfe, _6c9.cfs, _6c9.si, _78v.cfe, _78v.cfs, _78v.si, _85h.cfe, _85h.cfs, _85h.si, _923.cfe, _923.cfs, _923.si, _940.cfe, _940.cfs, _940.si, _95x.cfe, _95x.cfs, _95x.si, _97u.cfe, _97u.cfs, _97u.si, _99r.cfe, _99r.cfs, _99r.si, _9bo.cfe, _9bo.cfs, _9bo.si, _9dl.cfe, _9dl.cfs, _9dl.si, _9fi.cfe, _9fi.cfs, _9fi.si, _9hf.cfe, _9hf.cfs, _9hf.si, _9jc.cfe, _9jc.cfs, _9jc.si, _9l9.cfe, _9l9.cfs, _9l9.si, _9mp.cfe, _9mp.cfs, _9mp.si, _9mq.cfe, _9mq.cfs, _9mq.si, _9mr.cfe, _9mr.cfs, _9mr.si, _9ms.cfe, _9ms.cfs, _9ms.si, _9mt.cfe, _9mt.cfs, _9mt.si, _9mu.cfe, _9mu.cfs, _9mu.si, _9mv.cfe, _9mv.cfs, _9mv.si, _9mw.cfe, _9mw.cfs, _9mw.si, _9mx.cfe, _9mx.cfs, _9mx.si, _9my.cfe, _9my.cfs, _9my.si, _9mz.cfe, _9mz.cfs, _9mz.si, _9n0.cfe, _9n0.cfs, _9n0.si, _9n1.cfe, _9n1.cfs, _9n1.si, _9n2.cfe, _9n2.cfs, _9n2.si, _9n3.cfe, _9n3.cfs, _9n3.si, _9n4.cfe, _9n4.cfs, _9n4.si, _9n5.cfe, _9n5.cfs, _9n5.si, _wl.fdt, _wl.fdx, _wl.fnm, _wl.nvd, _wl.nvm, _wl.si, _wl_Lucene41_0.doc, _wl_Lucene41_0.tim, _wl_Lucene41_0.tip, segments_2]}]> but was:<[{indexVersion=1389336887409,generation=2,filelist=[_1t7.cfe, _1t7.cfs, _1t7.si, _2pt.cfe, _2pt.cfs, _2pt.si, _3mf.cfe, _3mf.cfs, _3mf.si, _4j1.cfe, _4j1.cfs, _4j1.si, _5fn.cfe, _5fn.cfs, _5fn.si, _6c9.cfe, _6c9.cfs, _6c9.si, _78v.cfe, _78v.cfs, _78v.si, _85h.cfe, _85h.cfs, _85h.si, _923.cfe, _923.cfs, _923.si, _940.cfe, _940.cfs, _940.si, _95x.cfe, _95x.cfs, _95x.si, _97u.cfe, _97u.cfs, _97u.si, _99r.cfe, _99r.cfs, _99r.si, _9bo.cfe, _9bo.cfs, _9bo.si, _9dl.cfe, _9dl.cfs, _9dl.si, _9fi.cfe, _9fi.cfs, _9fi.si, _9hf.cfe, _9hf.cfs, _9hf.si, _9jc.cfe, _9jc.cfs, _9jc.si, _9l9.cfe, _9l9.cfs, _9l9.si, _9mp.cfe, _9mp.cfs, _9mp.si, _9mq.cfe, _9mq.cfs, _9mq.si, _9mr.cfe, _9mr.cfs, _9mr.si, _9ms.cfe, _9ms.cfs, _9ms.si, _9mt.cfe, _9mt.cfs, _9mt.si, _9mu.cfe, _9mu.cfs, _9mu.si, _9mv.cfe, _9mv.cfs, _9mv.si, _9mw.cfe, _9mw.cfs, _9mw.si, _9mx.cfe, _9mx.cfs, _9mx.si, _9my.cfe, _9my.cfs, _9my.si, _9mz.cfe, _9mz.cfs, _9mz.si, _9n0.cfe, _9n0.cfs, _9n0.si, _9n1.cfe, _9n1.cfs, _9n1.si, _9n2.cfe, _9n2.cfs, _9n2.si, _9n3.cfe, _9n3.cfs, _9n3.si, _9n4.cfe, _9n4.cfs, _9n4.si, _9n5.cfe, _9n5.cfs, _9n5.si, _wl.fdt, _wl.fdx, _wl.fnm, _wl.nvd, _wl.nvm, _wl.si, _wl_Lucene41_0.doc, _wl_Lucene41_0.tim, _wl_Lucene41_0.tip, segments_2]}, {indexVersion=1389336887409,generation=3,filelist=[_1t7.cfe, _1t7.cfs, _1t7.si, _2pt.cfe, _2pt.cfs, _2pt.si, _3mf.cfe, _3mf.cfs, _3mf.si, _4j1.cfe, _4j1.cfs, _4j1.si, _5fn.cfe, _5fn.cfs, _5fn.si, _6c9.cfe, _6c9.cfs, _6c9.si, _78v.cfe, _78v.cfs, _78v.si, _85h.cfe, _85h.cfs, _85h.si, _923.cfe, _923.cfs, _923.si, _940.cfe, _940.cfs, _940.si, _95x.cfe, _95x.cfs, _95x.si, _97u.cfe, _97u.cfs, _97u.si, _99r.cfe, _99r.cfs, _99r.si, _9bo.cfe, _9bo.cfs, _9bo.si, _9dl.cfe, _9dl.cfs, _9dl.si, _9fi.cfe, _9fi.cfs, _9fi.si, _9hf.cfe, _9hf.cfs, _9hf.si, _9jc.cfe, _9jc.cfs, _9jc.si, _9l9.cfe, _9l9.cfs, _9l9.si, _9n6.cfe, _9n6.cfs, _9n6.si, _wl.fdt, _wl.fdx, _wl.fnm, _wl.nvd, _wl.nvm, _wl.si, _wl_Lucene41_0.doc, _wl_Lucene41_0.tim, _wl_Lucene41_0.tip, segments_3]}]>
Stack Trace:
java.lang.AssertionError: expected:<[{indexVersion=1389336887409,generation=2,filelist=[_1t7.cfe, _1t7.cfs, _1t7.si, _2pt.cfe, _2pt.cfs, _2pt.si, _3mf.cfe, _3mf.cfs, _3mf.si, _4j1.cfe, _4j1.cfs, _4j1.si, _5fn.cfe, _5fn.cfs, _5fn.si, _6c9.cfe, _6c9.cfs, _6c9.si, _78v.cfe, _78v.cfs, _78v.si, _85h.cfe, _85h.cfs, _85h.si, _923.cfe, _923.cfs, _923.si, _940.cfe, _940.cfs, _940.si, _95x.cfe, _95x.cfs, _95x.si, _97u.cfe, _97u.cfs, _97u.si, _99r.cfe, _99r.cfs, _99r.si, _9bo.cfe, _9bo.cfs, _9bo.si, _9dl.cfe, _9dl.cfs, _9dl.si, _9fi.cfe, _9fi.cfs, _9fi.si, _9hf.cfe, _9hf.cfs, _9hf.si, _9jc.cfe, _9jc.cfs, _9jc.si, _9l9.cfe, _9l9.cfs, _9l9.si, _9mp.cfe, _9mp.cfs, _9mp.si, _9mq.cfe, _9mq.cfs, _9mq.si, _9mr.cfe, _9mr.cfs, _9mr.si, _9ms.cfe, _9ms.cfs, _9ms.si, _9mt.cfe, _9mt.cfs, _9mt.si, _9mu.cfe, _9mu.cfs, _9mu.si, _9mv.cfe, _9mv.cfs, _9mv.si, _9mw.cfe, _9mw.cfs, _9mw.si, _9mx.cfe, _9mx.cfs, _9mx.si, _9my.cfe, _9my.cfs, _9my.si, _9mz.cfe, _9mz.cfs, _9mz.si, _9n0.cfe, _9n0.cfs, _9n0.si, _9n1.cfe, _9n1.cfs, _9n1.si, _9n2.cfe, _9n2.cfs, _9n2.si, _9n3.cfe, _9n3.cfs, _9n3.si, _9n4.cfe, _9n4.cfs, _9n4.si, _9n5.cfe, _9n5.cfs, _9n5.si, _wl.fdt, _wl.fdx, _wl.fnm, _wl.nvd, _wl.nvm, _wl.si, _wl_Lucene41_0.doc, _wl_Lucene41_0.tim, _wl_Lucene41_0.tip, segments_2]}]> but was:<[{indexVersion=1389336887409,generation=2,filelist=[_1t7.cfe, _1t7.cfs, _1t7.si, _2pt.cfe, _2pt.cfs, _2pt.si, _3mf.cfe, _3mf.cfs, _3mf.si, _4j1.cfe, _4j1.cfs, _4j1.si, _5fn.cfe, _5fn.cfs, _5fn.si, _6c9.cfe, _6c9.cfs, _6c9.si, _78v.cfe, _78v.cfs, _78v.si, _85h.cfe, _85h.cfs, _85h.si, _923.cfe, _923.cfs, _923.si, _940.cfe, _940.cfs, _940.si, _95x.cfe, _95x.cfs, _95x.si, _97u.cfe, _97u.cfs, _97u.si, _99r.cfe, _99r.cfs, _99r.si, _9bo.cfe, _9bo.cfs, _9bo.si, _9dl.cfe, _9dl.cfs, _9dl.si, _9fi.cfe, _9fi.cfs, _9fi.si, _9hf.cfe, _9hf.cfs, _9hf.si, _9jc.cfe, _9jc.cfs, _9jc.si, _9l9.cfe, _9l9.cfs, _9l9.si, _9mp.cfe, _9mp.cfs, _9mp.si, _9mq.cfe, _9mq.cfs, _9mq.si, _9mr.cfe, _9mr.cfs, _9mr.si, _9ms.cfe, _9ms.cfs, _9ms.si, _9mt.cfe, _9mt.cfs, _9mt.si, _9mu.cfe, _9mu.cfs, _9mu.si, _9mv.cfe, _9mv.cfs, _9mv.si, _9mw.cfe, _9mw.cfs, _9mw.si, _9mx.cfe, _9mx.cfs, _9mx.si, _9my.cfe, _9my.cfs, _9my.si, _9mz.cfe, _9mz.cfs, _9mz.si, _9n0.cfe, _9n0.cfs, _9n0.si, _9n1.cfe, _9n1.cfs, _9n1.si, _9n2.cfe, _9n2.cfs, _9n2.si, _9n3.cfe, _9n3.cfs, _9n3.si, _9n4.cfe, _9n4.cfs, _9n4.si, _9n5.cfe, _9n5.cfs, _9n5.si, _wl.fdt, _wl.fdx, _wl.fnm, _wl.nvd, _wl.nvm, _wl.si, _wl_Lucene41_0.doc, _wl_Lucene41_0.tim, _wl_Lucene41_0.tip, segments_2]}, {indexVersion=1389336887409,generation=3,filelist=[_1t7.cfe, _1t7.cfs, _1t7.si, _2pt.cfe, _2pt.cfs, _2pt.si, _3mf.cfe, _3mf.cfs, _3mf.si, _4j1.cfe, _4j1.cfs, _4j1.si, _5fn.cfe, _5fn.cfs, _5fn.si, _6c9.cfe, _6c9.cfs, _6c9.si, _78v.cfe, _78v.cfs, _78v.si, _85h.cfe, _85h.cfs, _85h.si, _923.cfe, _923.cfs, _923.si, _940.cfe, _940.cfs, _940.si, _95x.cfe, _95x.cfs, _95x.si, _97u.cfe, _97u.cfs, _97u.si, _99r.cfe, _99r.cfs, _99r.si, _9bo.cfe, _9bo.cfs, _9bo.si, _9dl.cfe, _9dl.cfs, _9dl.si, _9fi.cfe, _9fi.cfs, _9fi.si, _9hf.cfe, _9hf.cfs, _9hf.si, _9jc.cfe, _9jc.cfs, _9jc.si, _9l9.cfe, _9l9.cfs, _9l9.si, _9n6.cfe, _9n6.cfs, _9n6.si, _wl.fdt, _wl.fdx, _wl.fnm, _wl.nvd, _wl.nvm, _wl.si, _wl_Lucene41_0.doc, _wl_Lucene41_0.tim, _wl_Lucene41_0.tip, segments_3]}]>
at __randomizedtesting.SeedInfo.seed([21D3AF3AA7A6088:27CA21C3DA326E8B]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:147)
at org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1179)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
FAILED: org.apache.solr.search.TestFiltering.testHossssSanity
Error Message:
mismatch: '10'!='36' @ response/numFound
Stack Trace:
java.lang.RuntimeException: mismatch: '10'!='36' @ response/numFound
at __randomizedtesting.SeedInfo.seed([21D3AF3AA7A6088:A91439798FA08645]:0)
at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:730)
at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:678)
at org.apache.solr.search.TestFiltering.testHossssSanity(TestFiltering.java:366)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
Build Log:
[...truncated 9914 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4] 2> 2345708 T3391 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solrtest-OverseerTest-1389335917076
[junit4] 2> 2345709 T3391 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 2345713 T3391 oas.SolrTestCaseJ4.setUp ###Starting testStateChange
[junit4] 2> 2345713 T3391 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 2345714 T3392 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2345815 T3391 oasc.ZkTestServer.run start zk server on port:61288
[junit4] 2> 2345816 T3391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2345820 T3398 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4685a3d0 name:ZooKeeperConnection Watcher:127.0.0.1:61288/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2345820 T3391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2345821 T3391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2345823 T3400 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2fec2174 name:ZooKeeperConnection Watcher:127.0.0.1:61288 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2345823 T3391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2345837 T3391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2345839 T3402 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e9abfcf name:ZooKeeperConnection Watcher:127.0.0.1:61288 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2345839 T3391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2345839 T3391 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2345849 T3391 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2345851 T3391 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2345857 T3391 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2345859 T3391 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2345861 T3391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2345863 T3404 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@50317dd9 name:ZooKeeperConnection Watcher:127.0.0.1:61288/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2345863 T3391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2345864 T3391 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2345866 T3391 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2345881 T3391 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2345883 T3391 oasc.Overseer.start Overseer (id=91051518662344707-127.0.0.1:61288_solr-n_0000000000) starting
[junit4] 2> 2345894 T3391 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2345903 T3391 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2345906 T3391 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2345916 T3406 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2345917 T3405 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2345918 T3391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2345919 T3405 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2345919 T3405 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 2345920 T3405 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2345929 T3404 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2345930 T3398 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 2345970 T3391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2345972 T3404 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2345973 T3405 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2345974 T3405 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"active"}
[junit4] 2> 2345974 T3405 oasc.Overseer$ClusterStateUpdater.updateState node=core_node1 is already registered
[junit4] 2> 2345974 T3405 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2345976 T3404 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2346080 T3398 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 2346128 T3391 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:61288 61288
[junit4] 2> 2346190 T3391 oas.SolrTestCaseJ4.tearDown ###Ending testStateChange
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2346195 T3391 oas.SolrTestCaseJ4.setUp ###Starting testShardLeaderChange
[junit4] 2> 2346196 T3391 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 2346196 T3407 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2346297 T3391 oasc.ZkTestServer.run start zk server on port:60879
[junit4] 2> 2346298 T3391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2346302 T3413 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@79b1e080 name:ZooKeeperConnection Watcher:127.0.0.1:60879/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2346302 T3391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2346303 T3391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2346313 T3415 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5894df97 name:ZooKeeperConnection Watcher:127.0.0.1:60879 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2346313 T3391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2346354 T3391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2346355 T3417 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36fc5e66 name:ZooKeeperConnection Watcher:127.0.0.1:60879 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2346355 T3391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2346356 T3391 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2346365 T3391 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2346368 T3418 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2346369 T3391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2346371 T3420 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@121f11a3 name:ZooKeeperConnection Watcher:127.0.0.1:60879/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2346371 T3418 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2346377 T3422 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@565c549 name:ZooKeeperConnection Watcher:127.0.0.1:60879/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2346377 T3418 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2346377 T3391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2346378 T3391 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2346379 T3418 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2346380 T3391 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2346395 T3391 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2346481 T3418 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2346483 T3391 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 2346522 T3418 oasc.Overseer.start Overseer (id=91051518693736451-127.0.0.1:60879_solr-n_0000000000) starting
[junit4] 2> 2346530 T3422 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2346571 T3418 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2346572 T3391 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2346604 T3418 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2346643 T3418 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2346646 T3424 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2346646 T3418 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
[junit4] 2> 2346646 T3423 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2346707 T3418 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2346709 T3426 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@59308938 name:ZooKeeperConnection Watcher:127.0.0.1:60879/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2346710 T3418 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2346721 T3418 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2346723 T3418 oasc.Overseer.start Overseer (id=91051518693736453-127.0.0.1:60879_solr-n_0000000001) starting
[junit4] 2> 2346812 T3428 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2346812 T3427 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2346814 T3427 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2346814 T3427 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2346815 T3427 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
[junit4] 2> 2346815 T3427 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2346863 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2346864 T3422 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2347105 T3391 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2347145 T3391 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2347157 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2347168 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2347168 T3427 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2347168 T3391 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2347179 T3427 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2347180 T3427 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2347195 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2347195 T3391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2347198 T3430 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63077c9b name:ZooKeeperConnection Watcher:127.0.0.1:60879/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2347198 T3391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2347199 T3391 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2347201 T3391 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 2347204 T3430 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2347204 T3422 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2347211 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2347211 T3391 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2347212 T3427 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2347212 T3427 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2347224 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2347225 T3391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2347329 T3430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2347330 T3422 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2347427 T3391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2347431 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2347432 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2347432 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2347433 T3427 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2347433 T3427 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node2",
[junit4] 2> "core":"core4",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node2/solr/"}
[junit4] 2> 2347434 T3427 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4] 2> 2347434 T3427 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2347445 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2347547 T3430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2347547 T3422 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2347932 T3391 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2347949 T3430 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2347949 T3422 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2347956 T3391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2347957 T3430 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2347960 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2347961 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2347961 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2347961 T3427 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2347964 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348066 T3430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2348147 T3424 oasc.OverseerCollectionProcessor.amILeader org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:273)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:270)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:270)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.amILeader(OverseerCollectionProcessor.java:204)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:163)
[junit4] 2> at java.lang.Thread.run(Thread.java:679)
[junit4] 2>
[junit4] 2> 2348147 T3424 oasc.OverseerCollectionProcessor.amILeader According to ZK I (id=91051518693736451-127.0.0.1:60879_solr-n_0000000000) am no longer a leader.
[junit4] 2> 2348148 T3423 oasc.Overseer$ClusterStateUpdater.amILeader org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:273)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:270)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:270)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:394)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:153)
[junit4] 2> at java.lang.Thread.run(Thread.java:679)
[junit4] 2>
[junit4] 2> 2348148 T3423 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=91051518693736451-127.0.0.1:60879_solr-n_0000000000) am no longer a leader.
[junit4] 2> 2348158 T3391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2348160 T3391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2348162 T3432 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@152c905d name:ZooKeeperConnection Watcher:127.0.0.1:60879/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2348162 T3391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2348163 T3391 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2348165 T3391 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 2348167 T3430 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2348167 T3432 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2348168 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348168 T3391 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2348168 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348169 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348170 T3427 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2348171 T3427 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2348171 T3427 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2348173 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348173 T3432 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2348174 T3430 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2348175 T3432 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2348176 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348176 T3391 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2348176 T3427 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2348177 T3427 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2348179 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348182 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348182 T3391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2348184 T3434 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@57a6397b name:ZooKeeperConnection Watcher:127.0.0.1:60879/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2348184 T3391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2348185 T3391 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2348187 T3391 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 2348189 T3432 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2348189 T3434 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2348191 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348191 T3391 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2348192 T3427 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2348192 T3427 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2348194 T3426 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348196 T3391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2348226 T3418 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
[junit4] 2> 2348227 T3418 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2348229 T3436 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c06f399 name:ZooKeeperConnection Watcher:127.0.0.1:60879/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2348229 T3418 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2348231 T3418 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2348233 T3418 oasc.Overseer.start Overseer (id=91051518693736457-127.0.0.1:60879_solr-n_0000000002) starting
[junit4] 2> 2348237 T3438 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2348238 T3437 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2348239 T3437 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4] 2> 2348239 T3437 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2348239 T3437 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2348240 T3432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2348240 T3434 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2348242 T3437 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2348243 T3437 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2348243 T3434 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2348243 T3432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2348246 T3434 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2348246 T3432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2348248 T3437 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2348249 T3437 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2348249 T3434 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2348249 T3432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2348251 T3437 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2348295 T3427 oasc.Overseer$ClusterStateUpdater.run WARN Solr cannot talk to ZK, exiting Overseer main queue loop org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.orderedChildren(DistributedQueue.java:89)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:411)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:195)
[junit4] 2> at java.lang.Thread.run(Thread.java:679)
[junit4] 2>
[junit4] 2> 2348397 T3391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2348400 T3436 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348400 T3391 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2348401 T3437 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2348402 T3437 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node2",
[junit4] 2> "core":"core4",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node2/solr/"}
[junit4] 2> 2348402 T3437 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2348404 T3436 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348405 T3434 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2348405 T3432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2348407 T3434 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2348408 T3391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2348408 T3434 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2348412 T3436 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348413 T3437 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2348415 T3436 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348517 T3434 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2348609 T3391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2348611 T3391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2348612 T3440 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a01a260 name:ZooKeeperConnection Watcher:127.0.0.1:60879/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2348613 T3391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2348614 T3391 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2348616 T3391 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 2348618 T3434 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2348618 T3440 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2348620 T3436 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348620 T3391 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2348620 T3436 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348621 T3436 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348622 T3437 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2348622 T3437 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2348623 T3437 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2348625 T3436 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348626 T3434 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2348626 T3440 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2348628 T3440 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2348629 T3436 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348629 T3391 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2348629 T3437 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2348630 T3437 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2348632 T3436 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348633 T3436 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348636 T3391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2348636 T3436 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348637 T3442 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14f73cb1 name:ZooKeeperConnection Watcher:127.0.0.1:60879/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2348637 T3391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2348638 T3391 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2348640 T3391 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 2348641 T3418 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
[junit4] 2> 2348642 T3440 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2348642 T3418 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2348642 T3442 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2348644 T3444 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e7f4ba name:ZooKeeperConnection Watcher:127.0.0.1:60879/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2348644 T3418 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2348645 T3391 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2348647 T3418 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2348649 T3418 oasc.Overseer.start Overseer (id=91051518693736460-127.0.0.1:60879_solr-n_0000000003) starting
[junit4] 2> 2348650 T3391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2348653 T3446 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2348654 T3445 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2348655 T3445 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4] 2> 2348655 T3445 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2348656 T3445 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2348657 T3442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2348657 T3440 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2348659 T3445 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2348659 T3445 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2348660 T3440 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2348660 T3442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2348663 T3440 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2348663 T3442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2348664 T3445 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2348666 T3445 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2348666 T3445 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2348666 T3445 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2348668 T3444 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348669 T3440 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2348669 T3442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2348737 T3437 oasc.Overseer$ClusterStateUpdater.run WARN Solr cannot talk to ZK, exiting Overseer main queue loop org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.orderedChildren(DistributedQueue.java:89)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:411)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:195)
[junit4] 2> at java.lang.Thread.run(Thread.java:679)
[junit4] 2>
[junit4] 2> 2348852 T3391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2348855 T3444 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348855 T3391 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2348856 T3445 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2348857 T3445 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node2",
[junit4] 2> "core":"core4",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node2/solr/"}
[junit4] 2> 2348857 T3445 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2348874 T3444 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348875 T3442 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2348875 T3440 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2348882 T3391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2348883 T3442 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2348895 T3444 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2348903 T3444 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2349006 T3442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2349084 T3391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2349086 T3391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2349087 T3448 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@462a4998 name:ZooKeeperConnection Watcher:127.0.0.1:60879/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2349088 T3391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2349089 T3391 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2349090 T3391 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 2349093 T3442 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2349093 T3448 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2349095 T3444 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2349095 T3391 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2349095 T3444 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2349095 T3444 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2349097 T3445 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2349098 T3445 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2349098 T3445 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2349111 T3444 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2349111 T3442 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2349111 T3448 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2349113 T3448 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2349113 T3444 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2349113 T3391 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2349114 T3445 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2349114 T3445 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2349117 T3444 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2349120 T3444 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2349120 T3391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2349121 T3450 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d1b6d5e name:ZooKeeperConnection Watcher:127.0.0.1:60879/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2349122 T3391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2349122 T3391 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2349124 T3391 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 2349127 T3448 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2349127 T3450 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2349137 T3444 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2349137 T3391 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2349137 T3445 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2349138 T3445 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2349150 T3444 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2349152 T3391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2349158 T3418 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
[junit4] 2> 2349159 T3418 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2349161 T3452 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3eb7166f name:ZooKeeperConnection Watcher:127.0.0.1:60879/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2349161 T3418 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2349164 T3418 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2349165 T3418 oasc.Overseer.start Overseer (id=91051518693736463-127.0.0.1:60879_solr-n_0000000004) starting
[junit4] 2> 2349169 T3454 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2349170 T3453 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2349171 T3453 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4] 2> 2349171 T3453 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2349171 T3453 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2349172 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2349173 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2349174 T3453 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2349174 T3453 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2349175 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2349175 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2349178 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2349178 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2349180 T3453 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state1",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2349180 T3453 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2349181 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2349181 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2349183 T3453 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2349251 T3445 oasc.Overseer$ClusterStateUpdater.run WARN Solr cannot talk to ZK, exiting Overseer main queue loop org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.orderedChildren(DistributedQueue.java:89)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:411)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:195)
[junit4] 2> at java.lang.Thread.run(Thread.java:679)
[junit4] 2>
[junit4] 2> 2349353 T3391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2349357 T3452 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2349357 T3391 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2349358 T3453 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2349358 T3453 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"state2",
[junit4] 2> "node_name":"node2",
[junit4] 2> "core":"core4",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node2/solr/"}
[junit4] 2> 2349358 T3453 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2349375 T3452 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2349376 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2349376 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2349377 T3450 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2349378 T3391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2349378 T3450 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2349382 T3452 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2349383 T3453 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2349385 T3452 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2349450 T3422 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:136)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 2349450 T3422 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:136)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 2349487 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2349580 T3391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[...truncated too long message...]
34604 T3998 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@70410205
[junit4] 2> 3334604 T3998 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=5,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=4,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 3334604 T3998 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 3334605 T3998 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 3334605 T3998 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 3334606 T3998 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 3334607 T3998 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 3334607 T3998 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1389336905103/master/collection1/data/index [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1389336905103/master/collection1/data/index;done=false>>]
[junit4] 2> 3334607 T3998 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1389336905103/master/collection1/data/index
[junit4] 2> 3334608 T3998 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1389336905103/master/collection1/data [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1389336905103/master/collection1/data;done=false>>]
[junit4] 2> 3334608 T3998 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1389336905103/master/collection1/data
[junit4] 2> 3334608 T3998 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 3334661 T3998 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1164265480
[junit4] 2> 3334662 T3998 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@31672276
[junit4] 2> 3349635 T4929 oash.SnapPuller.fetchLatestIndex ERROR Master at: http://127.0.0.1:22016/solr is not available. Index fetch failed. Exception: IOException occured when talking to server at: http://127.0.0.1:22016/solr
[junit4] 2> 3349636 T3998 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 3349637 T3998 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 3349637 T3998 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 3349638 T3998 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 3349639 T3998 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 3349640 T3998 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 3349640 T3998 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1389336905454/slave/collection1/data/index [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1389336905454/slave/collection1/data/index;done=false>>]
[junit4] 2> 3349641 T3998 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1389336905454/slave/collection1/data/index
[junit4] 2> 3349641 T3998 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1389336905454/slave/collection1/data [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1389336905454/slave/collection1/data;done=false>>]
[junit4] 2> 3349642 T3998 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1389336905454/slave/collection1/data
[junit4] 2> 3349643 T3998 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 3349706 T3998 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: test params are: codec=Lucene45, sim=DefaultSimilarity, locale=ar_EG, timezone=Asia/Bishkek
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=1,free=132641304,total=362283008
[junit4] 2> NOTE: All tests run in this JVM: [RecoveryZkTest, TestLMJelinekMercerSimilarityFactory, TestHighFrequencyDictionaryFactory, TestStressVersions, PeerSyncTest, TestLuceneMatchVersion, TestRemoteStreaming, TermsComponentTest, DistributedQueryElevationComponentTest, ParsingFieldUpdateProcessorsTest, TestExtendedDismaxParser, UpdateParamsTest, TestSolrXml, HdfsBasicDistributedZk2Test, DistributedTermsComponentTest, TestLFUCache, TestTrie, SolrXmlInZkTest, TestSerializedLuceneMatchVersion, ShardRoutingTest, CoreAdminCreateDiscoverTest, TermVectorComponentTest, TestConfig, EchoParamsTest, TestDocBasedVersionConstraints, AnalysisAfterCoreReloadTest, BadCopyFieldTest, TestSolrXmlPersistor, DOMUtilTest, HdfsCollectionsAPIDistributedZkTest, TestReversedWildcardFilterFactory, TestRealTimeGet, TestLMDirichletSimilarityFactory, LegacyHTMLStripCharFilterTest, ExternalFileFieldSortTest, WordBreakSolrSpellCheckerTest, FastVectorHighlighterTest, TestDocumentBuilder, TestSchemaSimilarityResource, TestCharFilters, ResourceLoaderTest, SliceStateTest, SuggesterTest, TestSolrDeletionPolicy1, TestPostingsSolrHighlighter, ZkControllerTest, TestValueSourceCache, TestFunctionQuery, BasicDistributedZkTest, TestJoin, TestStressUserVersions, SuggesterFSTTest, SimpleFacetsTest, SoftAutoCommitTest, TestCopyFieldCollectionResource, DeleteShardTest, LeaderElectionTest, TestPseudoReturnFields, TestSuggestSpellingConverter, DistributedDebugComponentTest, URLClassifyProcessorTest, SchemaVersionSpecificBehaviorTest, SolrTestCaseJ4Test, TestRandomDVFaceting, SolrInfoMBeanTest, TestSurroundQueryParser, IndexSchemaTest, ClusterStateTest, CoreAdminHandlerTest, ClusterStateUpdateTest, TestBadConfig, TestSolrXMLSerializer, QueryParsingTest, TestFaceting, CopyFieldTest, QueryResultKeyTest, TestQueryUtils, TestReloadAndDeleteDocs, TestCollationFieldDocValues, TestSchemaNameResource, MoreLikeThisHandlerTest, SpatialFilterTest, TestNonNRTOpen, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, SyncSliceTest, OverseerTest, LeaderElectionIntegrationTest, TestReplicationHandler]
[junit4] Completed on J0 in 914.21s, 14 tests, 1 failure <<< FAILURES!
[...truncated 66 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:466: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:439: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/common-build.xml:491: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:1307: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:940: There were test failures: 348 suites, 1525 tests, 2 errors, 1 failure, 33 ignored (4 assumptions)
Total time: 124 minutes 24 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
UILD\\s+FAILED(?s:.*+) \
)"}