You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/05/02 06:54:42 UTC
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_60-ea-b14) -
Build # 10214 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10214/
Java: 64bit/jdk1.7.0_60-ea-b14 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.OverseerRolesTest.testDistribSearch
Error Message:
New overseer designate has not become the overseer, expected : 127.0.0.1:60020_er_eactual : null
Stack Trace:
java.lang.AssertionError: New overseer designate has not become the overseer, expected : 127.0.0.1:60020_er_eactual : null
at __randomizedtesting.SeedInfo.seed([34A090CA684B899:82AC8714D1DBD8A5]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.OverseerRolesTest.testOverseerRole(OverseerRolesTest.java:223)
at org.apache.solr.cloud.OverseerRolesTest.doTest(OverseerRolesTest.java:94)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:744)
REGRESSION: org.apache.solr.cloud.OverseerTest.testOverseerFailure
Error Message:
Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
Stack Trace:
org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
at __randomizedtesting.SeedInfo.seed([34A090CA684B899:74286FFB42157B8]:0)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:136)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:142)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:110)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:134)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:267)
at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:155)
at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:661)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:432)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:429)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:386)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:373)
at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:128)
at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:31)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:123)
... 47 more
Build Log:
[...truncated 11103 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerRolesTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/init-core-data-001
[junit4] 2> 699565 T3191 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /er_e/
[junit4] 2> 699568 T3191 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 699569 T3191 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 699569 T3192 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 699669 T3191 oasc.ZkTestServer.run start zk server on port:52913
[junit4] 2> 699670 T3191 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 699779 T3198 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5737abc1 name:ZooKeeperConnection Watcher:127.0.0.1:52913 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 699780 T3191 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 699780 T3191 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 699785 T3191 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 699786 T3200 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@341c04de name:ZooKeeperConnection Watcher:127.0.0.1:52913/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 699787 T3191 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 699787 T3191 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 699790 T3191 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 699795 T3191 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 699797 T3191 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 699799 T3191 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 699800 T3191 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 699804 T3191 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 699804 T3191 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 699807 T3191 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 699808 T3191 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 699810 T3191 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 699810 T3191 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 699813 T3191 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 699813 T3191 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 699816 T3191 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 699816 T3191 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 699819 T3191 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 699820 T3191 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 699822 T3191 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 699822 T3191 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 699824 T3191 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 699825 T3191 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 699827 T3191 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 699827 T3191 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 699829 T3191 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 699830 T3191 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 700153 T3191 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 700156 T3191 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:43815
[junit4] 2> 700156 T3191 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 700156 T3191 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 700157 T3191 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-002
[junit4] 2> 700157 T3191 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-002/'
[junit4] 2> 700171 T3191 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-002/solr.xml
[junit4] 2> 700193 T3191 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-002
[junit4] 2> 700194 T3191 oasc.CoreContainer.<init> New CoreContainer 1997884012
[junit4] 2> 700194 T3191 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-002/]
[junit4] 2> 700195 T3191 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 700195 T3191 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 700195 T3191 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 700195 T3191 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 700196 T3191 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 700196 T3191 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 700196 T3191 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 700196 T3191 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 700196 T3191 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 700197 T3191 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 700197 T3191 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 700197 T3191 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 700198 T3191 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52913/solr
[junit4] 2> 700198 T3191 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 700198 T3191 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 700200 T3211 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16c93588 name:ZooKeeperConnection Watcher:127.0.0.1:52913 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 700200 T3191 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 700204 T3191 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 700205 T3213 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@50a4daa8 name:ZooKeeperConnection Watcher:127.0.0.1:52913/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 700206 T3191 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 700207 T3191 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 700209 T3191 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 700212 T3191 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 700214 T3191 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 700217 T3191 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 700220 T3191 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 700222 T3191 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43815_er_e
[junit4] 2> 700223 T3191 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43815_er_e
[junit4] 2> 700225 T3191 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 700227 T3191 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 700235 T3191 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:43815_er_e
[junit4] 2> 700236 T3191 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 700238 T3191 oasc.Overseer.start Overseer (id=91685234263523331-127.0.0.1:43815_er_e-n_0000000000) starting
[junit4] 2> 700240 T3191 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 700249 T3215 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 700249 T3191 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 700250 T3215 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:43815_er_e
[junit4] 2> 700253 T3191 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 700254 T3191 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 700257 T3191 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-002
[junit4] 2> 700259 T3214 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 700263 T3191 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-002/conf/
[junit4] 2> 700366 T3191 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 700367 T3191 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 700367 T3191 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 700368 T3191 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 700370 T3218 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70599e0 name:ZooKeeperConnection Watcher:127.0.0.1:52913/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 700370 T3191 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 700371 T3191 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 700374 T3191 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 700603 T3191 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 700604 T3191 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 700605 T3191 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:39962
[junit4] 2> 700606 T3191 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 700606 T3191 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 700606 T3191 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-003
[junit4] 2> 700607 T3191 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-003/'
[junit4] 2> 700620 T3191 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-003/solr.xml
[junit4] 2> 700662 T3191 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-003
[junit4] 2> 700662 T3191 oasc.CoreContainer.<init> New CoreContainer 2146521090
[junit4] 2> 700663 T3191 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-003/]
[junit4] 2> 700663 T3191 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 700663 T3191 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 700664 T3191 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 700664 T3191 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 700664 T3191 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 700664 T3191 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 700664 T3191 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 700665 T3191 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 700665 T3191 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 700665 T3191 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 700666 T3191 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 700666 T3191 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 700666 T3191 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52913/solr
[junit4] 2> 700666 T3191 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 700667 T3191 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 700668 T3229 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3bbbf4ed name:ZooKeeperConnection Watcher:127.0.0.1:52913 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 700668 T3191 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 700670 T3191 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 700671 T3231 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3ea783a3 name:ZooKeeperConnection Watcher:127.0.0.1:52913/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 700672 T3191 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 700676 T3191 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 701678 T3191 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39962_er_e
[junit4] 2> 701679 T3191 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39962_er_e
[junit4] 2> 701686 T3191 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-003
[junit4] 2> 701690 T3191 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-003/conf/
[junit4] 2> 701783 T3191 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 701784 T3191 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 701784 T3191 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 702007 T3191 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 702007 T3191 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 702010 T3191 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53357
[junit4] 2> 702010 T3191 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 702011 T3191 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 702011 T3191 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-004
[junit4] 2> 702011 T3191 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-004/'
[junit4] 2> 702026 T3191 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-004/solr.xml
[junit4] 2> 702065 T3191 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-004
[junit4] 2> 702065 T3191 oasc.CoreContainer.<init> New CoreContainer 667629671
[junit4] 2> 702066 T3191 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-004/]
[junit4] 2> 702066 T3191 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 702067 T3191 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 702067 T3191 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 702067 T3191 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 702067 T3191 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 702067 T3191 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 702068 T3191 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 702068 T3191 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 702068 T3191 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 702069 T3191 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 702069 T3191 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 702069 T3191 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 702069 T3191 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52913/solr
[junit4] 2> 702070 T3191 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 702070 T3191 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 702072 T3243 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ee4069a name:ZooKeeperConnection Watcher:127.0.0.1:52913 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 702072 T3191 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 702074 T3191 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 702075 T3245 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7857d058 name:ZooKeeperConnection Watcher:127.0.0.1:52913/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 702075 T3191 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 702082 T3191 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 703084 T3191 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53357_er_e
[junit4] 2> 703085 T3191 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53357_er_e
[junit4] 2> 703093 T3191 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-004
[junit4] 2> 703098 T3191 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-004/conf/
[junit4] 2> 703184 T3191 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 703185 T3191 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 703185 T3191 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 703410 T3191 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 703410 T3191 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 703412 T3191 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60020
[junit4] 2> 703413 T3191 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 703413 T3191 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 703413 T3191 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-005
[junit4] 2> 703413 T3191 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-005/'
[junit4] 2> 703426 T3191 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-005/solr.xml
[junit4] 2> 703448 T3191 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-005
[junit4] 2> 703449 T3191 oasc.CoreContainer.<init> New CoreContainer 355248949
[junit4] 2> 703449 T3191 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-005/]
[junit4] 2> 703450 T3191 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 703450 T3191 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 703450 T3191 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 703450 T3191 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 703451 T3191 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 703451 T3191 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 703451 T3191 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 703451 T3191 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 703451 T3191 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 703452 T3191 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 703452 T3191 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 703452 T3191 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 703453 T3191 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52913/solr
[junit4] 2> 703453 T3191 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 703454 T3191 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 703455 T3257 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@279c2f6f name:ZooKeeperConnection Watcher:127.0.0.1:52913 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 703455 T3191 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 703458 T3191 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 703460 T3259 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75dafc0d name:ZooKeeperConnection Watcher:127.0.0.1:52913/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 703460 T3191 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 703464 T3191 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 704467 T3191 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60020_er_e
[junit4] 2> 704468 T3191 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60020_er_e
[junit4] 2> 704476 T3191 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-005
[junit4] 2> 704485 T3191 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-005/conf/
[junit4] 2> 704619 T3191 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 704620 T3191 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 704620 T3191 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 704845 T3191 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
[junit4] 2> 704846 T3191 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 704848 T3191 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:34643
[junit4] 2> 704848 T3191 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 704849 T3191 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 704849 T3191 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-006
[junit4] 2> 704849 T3191 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-006/'
[junit4] 2> 704862 T3191 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-006/solr.xml
[junit4] 2> 704900 T3191 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-006
[junit4] 2> 704901 T3191 oasc.CoreContainer.<init> New CoreContainer 1808226142
[junit4] 2> 704901 T3191 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-006/]
[junit4] 2> 704901 T3191 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 704902 T3191 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 704902 T3191 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 704902 T3191 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 704903 T3191 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 704903 T3191 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 704903 T3191 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 704903 T3191 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 704903 T3191 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 704904 T3191 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 704904 T3191 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 704904 T3191 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 704905 T3191 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52913/solr
[junit4] 2> 704905 T3191 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 704906 T3191 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 704907 T3271 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6c391399 name:ZooKeeperConnection Watcher:127.0.0.1:52913 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 704907 T3191 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 704910 T3191 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 704912 T3273 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19a6d289 name:ZooKeeperConnection Watcher:127.0.0.1:52913/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 704912 T3191 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 704917 T3191 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 705920 T3191 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34643_er_e
[junit4] 2> 705921 T3191 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34643_er_e
[junit4] 2> 705929 T3191 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-006
[junit4] 2> 705935 T3191 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-006/conf/
[junit4] 2> 706030 T3191 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 706031 T3191 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 706031 T3191 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 706249 T3191 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 5
[junit4] 2> 706250 T3191 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 706252 T3191 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:57371
[junit4] 2> 706253 T3191 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 706253 T3191 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 706253 T3191 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-007
[junit4] 2> 706254 T3191 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-007/'
[junit4] 2> 706267 T3191 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-007/solr.xml
[junit4] 2> 706310 T3191 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-007
[junit4] 2> 706310 T3191 oasc.CoreContainer.<init> New CoreContainer 1617813732
[junit4] 2> 706311 T3191 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-007/]
[junit4] 2> 706311 T3191 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 706311 T3191 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 706312 T3191 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 706312 T3191 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 706312 T3191 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 706312 T3191 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 706313 T3191 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 706313 T3191 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 706313 T3191 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 706313 T3191 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 706314 T3191 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 706314 T3191 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 706314 T3191 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52913/solr
[junit4] 2> 706314 T3191 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 706315 T3191 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 706317 T3285 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4dc7ca31 name:ZooKeeperConnection Watcher:127.0.0.1:52913 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 706318 T3191 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 706328 T3191 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 706329 T3287 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3af8bef9 name:ZooKeeperConnection Watcher:127.0.0.1:52913/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 706330 T3191 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 706334 T3191 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 707336 T3191 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57371_er_e
[junit4] 2> 707338 T3191 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57371_er_e
[junit4] 2> 707344 T3191 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-007
[junit4] 2> 707349 T3191 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-007/conf/
[junit4] 2> 707440 T3191 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 707441 T3191 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 707442 T3191 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 707722 T3191 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 6
[junit4] 2> 707723 T3191 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 707725 T3191 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:43032
[junit4] 2> 707726 T3191 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 707726 T3191 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 707727 T3191 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-008
[junit4] 2> 707727 T3191 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-008/'
[junit4] 2> 707743 T3191 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-008/solr.xml
[junit4] 2> 707766 T3191 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-008
[junit4] 2> 707766 T3191 oasc.CoreContainer.<init> New CoreContainer 386131834
[junit4] 2> 707767 T3191 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-008/]
[junit4] 2> 707767 T3191 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 707768 T3191 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 707768 T3191 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 707768 T3191 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 707768 T3191 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 707768 T3191 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 707769 T3191 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 707769 T3191 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 707769 T3191 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 707770 T3191 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 707770 T3191 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 707770 T3191 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 707770 T3191 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52913/solr
[junit4] 2> 707771 T3191 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 707771 T3191 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 707773 T3299 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1520664 name:ZooKeeperConnection Watcher:127.0.0.1:52913 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 707773 T3191 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 707775 T3191 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 707777 T3301 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f5545d name:ZooKeeperConnection Watcher:127.0.0.1:52913/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 707777 T3191 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 707784 T3191 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 708787 T3191 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43032_er_e
[junit4] 2> 708788 T3191 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43032_er_e
[junit4] 2> 708795 T3191 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-008
[junit4] 2> 708801 T3191 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-008/conf/
[junit4] 2> 708934 T3191 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 708936 T3191 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 708936 T3191 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 708937 T3191 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 708939 T3304 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@199425ec name:ZooKeeperConnection Watcher:127.0.0.1:52913/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 708939 T3191 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 708940 T3191 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 708942 T3191 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 708943 T3306 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e91de99 name:ZooKeeperConnection Watcher:127.0.0.1:52913/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 708944 T3191 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 708944 T3191 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 708949 T3266 oasha.CollectionsHandler.handleCreateAction Creating Collection : version=2&wt=javabin&numShards=4&replicationFactor=2&action=CREATE&maxShardsPerNode=2&name=testOverseerQuit
[junit4] 2> 708950 T3213 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 708951 T3215 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"testOverseerQuit",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"4",
[junit4] 2> "maxShardsPerNode":"2"}
[junit4] 2> 708951 T3215 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"testOverseerQuit",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"4",
[junit4] 2> "maxShardsPerNode":"2"}
[junit4] 2> 708952 T3215 oasc.OverseerCollectionProcessor.createConfNode Only one config set found in zk - using it:conf1
[junit4] 2> 708953 T3215 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/testOverseerQuit
[junit4] 2> 708953 T3215 oascc.SolrZkClient.makePath makePath: /collections/testOverseerQuit
[junit4] 2> 708956 T3213 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 708957 T3214 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 708957 T3214 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: testOverseerQuit
[junit4] 2> 708957 T3214 oasc.Overseer$ClusterStateUpdater.createCollection Create collection testOverseerQuit with shards [shard1, shard2, shard3, shard4]
[junit4] 2> 708959 T3213 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 708960 T3218 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 708960 T3245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 708960 T3304 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 708961 T3287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 708961 T3213 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 708960 T3273 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 708961 T3301 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 708960 T3231 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 708960 T3259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 708960 T3306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 709056 T3215 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection, shardNames [shard1, shard2, shard3, shard4] , replicationFactor : 2
[junit4] 2> 709056 T3215 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard1_replica1 as part of slice shard1 of collection testOverseerQuit on 127.0.0.1:43815_er_e
[junit4] 2> 709057 T3215 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard1_replica2 as part of slice shard1 of collection testOverseerQuit on 127.0.0.1:43032_er_e
[junit4] 2> 709058 T3215 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard2_replica1 as part of slice shard2 of collection testOverseerQuit on 127.0.0.1:53357_er_e
[junit4] 2> 709059 T3215 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard2_replica2 as part of slice shard2 of collection testOverseerQuit on 127.0.0.1:39962_er_e
[junit4] 2> 709059 T3205 oasha.CoreAdminHandler.handleCreateAction core create command version=2&wt=javabin&qt=/admin/cores&numShards=4&shard=shard1&collection.configName=conf1&action=CREATE&collection=testOverseerQuit&name=testOverseerQuit_shard1_replica1
[junit4] 2> 709060 T3215 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard3_replica1 as part of slice shard3 of collection testOverseerQuit on 127.0.0.1:34643_er_e
[junit4] 2> 709060 T3294 oasha.CoreAdminHandler.handleCreateAction core create command version=2&wt=javabin&qt=/admin/cores&numShards=4&shard=shard1&collection.configName=conf1&action=CREATE&collection=testOverseerQuit&name=testOverseerQuit_shard1_replica2
[junit4] 2> 709061 T3215 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard3_replica2 as part of slice shard3 of collection testOverseerQuit on 127.0.0.1:60020_er_e
[junit4] 2> 709061 T3205 oasc.ZkController.publish publishing core=testOverseerQuit_shard1_replica1 state=down collection=testOverseerQuit
[junit4] 2> 709061 T3239 oasha.CoreAdminHandler.handleCreateAction core create command version=2&wt=javabin&qt=/admin/cores&numShards=4&shard=shard2&collection.configName=conf1&action=CREATE&collection=testOverseerQuit&name=testOverseerQuit_shard2_replica1
[junit4] 2> 709062 T3227 oasha.CoreAdminHandler.handleCreateAction core create command version=2&wt=javabin&qt=/admin/cores&numShards=4&shard=shard2&collection.configName=conf1&action=CREATE&collection=testOverseerQuit&name=testOverseerQuit_shard2_replica2
[junit4] 2> 709063 T3267 oasha.CoreAdminHandler.handleCreateAction core create command version=2&wt=javabin&qt=/admin/cores&numShards=4&shard=shard3&collection.configName=conf1&action=CREATE&collection=testOverseerQuit&name=testOverseerQuit_shard3_replica1
[junit4] 2> 709064 T3294 oasc.ZkController.publish publishing core=testOverseerQuit_shard1_replica2 state=down collection=testOverseerQuit
[junit4] 2> 709064 T3215 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard4_replica1 as part of slice shard4 of collection testOverseerQuit on 127.0.0.1:57371_er_e
[junit4] 2> 709065 T3213 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 709066 T3205 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 709066 T3215 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard4_replica2 as part of slice shard4 of collection testOverseerQuit on 127.0.0.1:43815_er_e
[junit4] 2> 709066 T3253 oasha.CoreAdminHandler.handleCreateAction core create command version=2&wt=javabin&qt=/admin/cores&numShards=4&shard=shard3&collection.configName=conf1&action=CREATE&collection=testOverseerQuit&name=testOverseerQuit_shard3_replica2
[junit4] 2> 709068 T3281 oasha.CoreAdminHandler.handleCreateAction core create command version=2&wt=javabin&qt=/admin/cores&numShards=4&shard=shard4&collection.configName=conf1&action=CREATE&collection=testOverseerQuit&name=testOverseerQuit_shard4_replica1
[junit4] 2> 709073 T3294 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 709073 T3227 oasc.ZkController.publish publishing core=testOverseerQuit_shard2_replica2 state=down collection=testOverseerQuit
[junit4] 2> 709073 T3239 oasc.ZkController.publish publishing core=testOverseerQuit_shard2_replica1 state=down collection=testOverseerQuit
[junit4] 2> 709074 T3253 oasc.ZkController.publish publishing core=testOverseerQuit_shard3_replica2 state=down collection=testOverseerQuit
[junit4] 2> 709073 T3267 oasc.ZkController.publish publishing core=testOverseerQuit_shard3_replica1 state=down collection=testOverseerQuit
[junit4] 2> 709075 T3209 oasha.CoreAdminHandler.handleCreateAction core create command version=2&wt=javabin&qt=/admin/cores&numShards=4&shard=shard4&collection.configName=conf1&action=CREATE&collection=testOverseerQuit&name=testOverseerQuit_shard4_replica2
[junit4] 2> 709075 T3239 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 709075 T3213 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 709076 T3253 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 709075 T3214 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 709074 T3227 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 709074 T3281 oasc.ZkController.publish publishing core=testOverseerQuit_shard4_replica1 state=down collection=testOverseerQuit
[junit4] 2> 709077 T3209 oasc.ZkController.publish publishing core=testOverseerQuit_shard4_replica2 state=down collection=testOverseerQuit
[junit4] 2> 709076 T3267 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 709078 T3214 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:43815/er_e",
[junit4] 2> "core":"testOverseerQuit_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:43815_er_e",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testOverseerQuit",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 709079 T3281 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 709079 T3209 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 709081 T3214 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:43032/er_e",
[junit4] 2> "core":"testOverseerQuit_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:43032_er_e",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testOverseerQuit",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 709082 T3213 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 709083 T3214 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:39962/er_e",
[junit4] 2> "core":"testOverseerQuit_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:39962_er_e",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testOverseerQuit",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 709085 T3213 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 709086 T3214 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:53357/er_e",
[junit4] 2> "core":"testOverseerQuit_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53357_er_e",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testOverseerQuit",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 709087 T3213 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 709088 T3214 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:60020/er_e",
[junit4] 2> "core":"testOverseerQuit_shard3_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:60020_er_e",
[junit4] 2> "shard":"shard3",
[junit4] 2> "collection":"testOverseerQuit",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 709090 T3213 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 709091 T3214 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:34643/er_e",
[junit4] 2> "core":"testOverseerQuit_shard3_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:34643_er_e",
[junit4] 2> "shard":"shard3",
[junit4] 2> "collection":"testOverseerQuit",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 709092 T3213 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 709093 T3214 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:57371/er_e",
[junit4] 2> "core":"testOverseerQuit_shard4_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:57371_er_e",
[junit4] 2> "shard":"shard4",
[junit4] 2> "collection":"testOverseerQuit",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 709095 T3213 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 709096 T3214 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:43815/er_e",
[junit4] 2> "core":"testOverseerQuit_shard4_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:43815_er_e",
[junit4] 2> "shard":"shard4",
[junit4] 2> "collection":"testOverseerQuit",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 709098 T3213 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 709201 T3304 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 709202 T3218 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 709202 T3213 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 709202 T3259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 709202 T3231 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 709202 T3306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 709202 T3273 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 709202 T3287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 709201 T3301 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 709201 T3245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 710066 T3205 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard1_replica1
[junit4] 2> 710067 T3205 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
[junit4] 2> 710068 T3205 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 710068 T3205 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
[junit4] 2> 710069 T3205 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 710069 T3205 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-002/testOverseerQuit_shard1_replica1/'
[junit4] 2> 710073 T3294 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard1_replica2
[junit4] 2> 710074 T3294 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
[junit4] 2> 710075 T3294 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 710075 T3294 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
[junit4] 2> 710076 T3294 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 710076 T3294 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-008/testOverseerQuit_shard1_replica2/'
[junit4] 2> 710076 T3239 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard2_replica1
[junit4] 2> 710077 T3253 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard3_replica2
[junit4] 2> 710077 T3239 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
[junit4] 2> 710078 T3253 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
[junit4] 2> 710078 T3239 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 710078 T3239 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
[junit4] 2> 710078 T3227 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard2_replica2
[junit4] 2> 710078 T3253 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 710079 T3281 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard4_replica1
[junit4] 2> 710079 T3209 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard4_replica2
[junit4] 2> 710080 T3281 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
[junit4] 2> 710078 T3267 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard3_replica1
[junit4] 2> 710080 T3209 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
[junit4] 2> 710080 T3227 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
[junit4] 2> 710079 T3239 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 710081 T3239 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-004/testOverseerQuit_shard2_replica1/'
[junit4] 2> 710079 T3253 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
[junit4] 2> 710081 T3227 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 710081 T3209 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 710083 T3209 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
[junit4] 2> 710083 T3253 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 710081 T3267 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
[junit4] 2> 710084 T3209 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 710081 T3281 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 710084 T3267 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 710084 T3267 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
[junit4] 2> 710084 T3209 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-002/testOverseerQuit_shard4_replica2/'
[junit4] 2> 710083 T3253 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-005/testOverseerQuit_shard3_replica2/'
[junit4] 2> 710082 T3227 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
[junit4] 2> 710084 T3281 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
[junit4] 2> 710090 T3267 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 710090 T3267 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-006/testOverseerQuit_shard3_replica1/'
[junit4] 2> 710093 T3281 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 710093 T3227 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 710093 T3281 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-007/testOverseerQuit_shard4_replica1/'
[junit4] 2> 710094 T3227 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-003/testOverseerQuit_shard2_replica2/'
[junit4] 2> 710132 T3205 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 710133 T3239 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 710189 T3281 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 710197 T3294 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 710217 T3209 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 710223 T3253 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 710259 T3267 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 710261 T3227 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 710282 T3281 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 710283 T3239 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 710284 T3281 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 710284 T3239 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 710286 T3205 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 710324 T3205 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 710333 T3281 oass.IndexSchema.readSchema [testOverseerQuit_shard4_replica1] Schema name=test
[junit4] 2> 710336 T3209 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 710333 T3205 oass.IndexSchema.readSchema [testOverseerQuit_shard1_replica1] Schema name=test
[junit4] 2> 710344 T3239 oass.IndexSchema.readSchema [testOverseerQuit_shard2_replica1] Schema name=test
[junit4] 2> 710377 T3253 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 710381 T3294 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 710383 T3209 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 710383 T3294 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 710399 T3253 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 710404 T3227 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 710405 T3209 oass.IndexSchema.readSchema [testOverseerQuit_shard4_replica2] Schema name=test
[junit4] 2> 710405 T3294 oass.IndexSchema.readSchema [testOverseerQuit_shard1_replica2] Schema name=test
[junit4] 2> 710413 T3227 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 710413 T3253 oass.IndexSchema.readSchema [testOverseerQuit_shard3_replica2] Schema name=test
[junit4] 2> 710443 T3267 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 710476 T3227 oass.IndexSchema.readSchema [testOverseerQuit_shard2_replica2] Schema name=test
[junit4] 2> 710518 T3267 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 710544 T3267 oass.IndexSchema.readSchema [testOverseerQuit_shard3_replica1] Schema name=test
[junit4] 2> 711340 T3239 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 711349 T3239 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 711352 T3239 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 711384 T3205 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 711387 T3239 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 711391 T3239 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 711392 T3205 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 711407 T3205 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 711407 T3281 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 711407 T3239 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 711414 T3239 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 711441 T3253 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 711420 T3281 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 711441 T3239 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 711444 T3239 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 711445 T3239 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 711446 T3239 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 711446 T3239 oasc.CoreContainer.create Creating SolrCore 'testOverseerQuit_shard2_replica1' using configuration from collection testOverseerQuit
[junit4] 2> 711446 T3239 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 711448 T3239 oasc.SolrCore.<init> [testOverseerQuit_shard2_replica1] Opening new SolrCore at ./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-004/testOverseerQuit_shard2_replica1/, dataDir=./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-004/testOverseerQuit_shard2_replica1/data/
[junit4] 2> 711448 T3239 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@11dc64f9
[junit4] 2> 711450 T3281 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 711451 T3227 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 711453 T3239 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-004/testOverseerQuit_shard2_replica1/data
[junit4] 2> 711455 T3239 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-004/testOverseerQuit_shard2_replica1/data/index/
[junit4] 2> 711455 T3239 oasc.SolrCore.initIndex WARN [testOverseerQuit_shard2_replica1] Solr index directory './solr.cloud.OverseerRolesTest-34A090CA684B899-001/tempDir-004/testOverseerQuit_shard2_replica1/data/index' doesn't exist
[...truncated too long message...]
leader_elect/shard3/election
[junit4] 2> 1021958 T4546 oascc.SolrZkClient.makePath makePath: /collections/collection2/leaders/shard3
[junit4] 2> 1021961 T5057 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1021962 T5057 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1021962 T5057 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1022004 T5057 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1022004 T5058 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1022008 T5058 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core3",
[junit4] 2> "core_node_name":"node3",
[junit4] 2> "collection":"collection2",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 1022008 T5058 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1022009 T5058 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1022010 T5057 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1022113 T5061 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1022113 T5055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1022504 T4546 oascc.SolrZkClient.makePath makePath: /collections/collection2/leader_elect/shard1/election
[junit4] 2> 1022509 T4546 oascc.SolrZkClient.makePath makePath: /collections/collection2/leaders/shard1
[junit4] 2> 1022554 T5057 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1022554 T5057 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1022554 T5057 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1022555 T5058 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1022558 T5057 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1022660 T5055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1022661 T5061 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1022708 T4546 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:52986 52986
[junit4] 2> 1022923 T5045 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:52986 52986
[junit4] 2> 1022924 T4546 oas.SolrTestCaseJ4.tearDown ###Ending testBadQueueItem
[junit4] 2> 1022924 T5058 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:52986_solr
[junit4] 2> 1022925 T5062 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:306)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 1022926 T4546 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 1022926 T4546 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 1025926 T4546 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerTest-34A090CA684B899-001
[junit4] 2> NOTE: test params are: codec=Lucene46: {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=en_ZA, timezone=Asia/Riyadh88
[junit4] 2> NOTE: Linux 3.8.0-38-generic amd64/Oracle Corporation 1.7.0_60-ea (64-bit)/cpus=8,threads=1,free=54539824,total=310988800
[junit4] 2> NOTE: All tests run in this JVM: [SystemInfoHandlerTest, CachingDirectoryFactoryTest, DirectSolrConnectionTest, CollectionsAPIAsyncDistributedZkTest, TestOmitPositions, SolrTestCaseJ4Test, MigrateRouteKeyTest, HdfsUnloadDistributedZkTest, NotRequiredUniqueKeyTest, TestSolrQueryParserDefaultOperatorResource, TestPhraseSuggestions, DisMaxRequestHandlerTest, QueryResultKeyTest, NumericFieldsTest, TestFastWriter, NoCacheHeaderTest, TestArbitraryIndexDir, HighlighterTest, ChaosMonkeySafeLeaderTest, PingRequestHandlerTest, TestDistributedSearch, TestFiltering, TestCSVResponseWriter, SolrCoreCheckLockOnStartupTest, HdfsDirectoryTest, TestLRUCache, SuggesterTSTTest, CustomCollectionTest, RemoteQueryErrorTest, DeleteReplicaTest, ShardRoutingCustomTest, TestSweetSpotSimilarityFactory, AddSchemaFieldsUpdateProcessorFactoryTest, XmlUpdateRequestHandlerTest, AddBlockUpdateTest, SolrPluginUtilsTest, SpellCheckCollatorTest, CurrencyFieldXmlFileTest, UniqFieldsUpdateProcessorFactoryTest, TestCursorMarkWithoutUniqueKey, HdfsChaosMonkeySafeLeaderTest, SuggesterWFSTTest, DefaultValueUpdateProcessorTest, HighlighterConfigTest, TestSolrQueryParserResource, TestIBSimilarityFactory, SpellCheckComponentTest, TestRangeQuery, JSONWriterTest, RangeFacetTest, TestRTGBase, TestFieldTypeCollectionResource, OpenExchangeRatesOrgProviderTest, TestUniqueKeyFieldResource, TestDFRSimilarityFactory, FieldAnalysisRequestHandlerTest, TestBinaryResponseWriter, TestCollationFieldDocValues, TestRandomFaceting, TestAtomicUpdateErrorCases, DebugComponentTest, DocumentAnalysisRequestHandlerTest, BasicZkTest, TestDistributedGrouping, TestCloudManagedSchemaAddField, TestHashPartitioner, DistributedSuggestComponentTest, StressHdfsTest, SortByFunctionTest, DateFieldTest, TestCodecSupport, RequiredFieldsTest, IndexBasedSpellCheckerTest, TestSolr4Spatial, DeleteInactiveReplicaTest, RequestHandlersTest, BasicDistributedZk2Test, ResourceLoaderTest, TestDefaultSearchFieldResource, TestReloadAndDeleteDocs, TestBinaryField, DocValuesMissingTest, TestFoldingMultitermQuery, TestExceedMaxTermLength, DirectUpdateHandlerTest, SimplePostToolTest, NoFacetTest, TestFastOutputStream, CoreContainerCoreInitFailuresTest, TestLMDirichletSimilarityFactory, BlockCacheTest, OverseerRolesTest, SSLMigrationTest, InfoHandlerTest, DistributedQueryComponentOptimizationTest, PathHierarchyTokenizerFactoryTest, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, OpenCloseCoreStressTest, OverseerTest]
[junit4] Completed on J1 in 44.77s, 9 tests, 1 error <<< FAILURES!
[...truncated 663 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1296: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:920: There were test failures: 398 suites, 1669 tests, 1 error, 1 failure, 37 ignored (16 assumptions)
Total time: 56 minutes 1 second
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_60-ea-b14 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure