You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/05/11 19:56:12 UTC

[JENKINS] Lucene-Solr-4.8-Linux (32bit/jdk1.7.0_55) - Build # 147 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.8-Linux/147/
Java: 32bit/jdk1.7.0_55 -server -XX:+UseSerialGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.OverseerRolesTest.testDistribSearch

Error Message:
could not set the new overseer . expected 127.0.0.1:44866_lb%2Fz current order : [127.0.0.1:44866_lb%2Fz, 127.0.0.1:34442_lb%2Fz, 127.0.0.1:55059_lb%2Fz, 127.0.0.1:41627_lb%2Fz, 127.0.0.1:43581_lb%2Fz, 127.0.0.1:54770_lb%2Fz, 127.0.0.1:60294_lb%2Fz] ldr :null

Stack Trace:
java.lang.AssertionError: could not set the new overseer . expected 127.0.0.1:44866_lb%2Fz current order : [127.0.0.1:44866_lb%2Fz, 127.0.0.1:34442_lb%2Fz, 127.0.0.1:55059_lb%2Fz, 127.0.0.1:41627_lb%2Fz, 127.0.0.1:43581_lb%2Fz, 127.0.0.1:54770_lb%2Fz, 127.0.0.1:60294_lb%2Fz] ldr :null
	at __randomizedtesting.SeedInfo.seed([6062E6A9467F40E3:E18468B1312020DF]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.OverseerRolesTest.testOverseerRole(OverseerRolesTest.java:159)
	at org.apache.solr.cloud.OverseerRolesTest.doTest(OverseerRolesTest.java:95)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 10817 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerRolesTest
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/init-core-data-001
   [junit4]   2> 128739 T464 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /lb/z
   [junit4]   2> 128743 T464 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 128743 T464 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 128744 T465 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 128844 T464 oasc.ZkTestServer.run start zk server on port:52788
   [junit4]   2> 128845 T464 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 128852 T471 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@111fc6 name:ZooKeeperConnection Watcher:127.0.0.1:52788 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 128852 T464 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 128852 T464 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 128856 T464 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 128858 T473 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c06d30 name:ZooKeeperConnection Watcher:127.0.0.1:52788/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 128858 T464 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 128858 T464 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 128861 T464 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 128862 T464 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 128864 T464 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 128866 T464 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 128866 T464 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 128870 T464 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 128870 T464 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 128872 T464 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 128873 T464 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 128875 T464 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 128875 T464 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 128877 T464 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 128878 T464 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 128883 T464 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 128883 T464 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 128887 T464 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 128887 T464 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 128890 T464 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 128891 T464 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 128894 T464 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 128894 T464 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 128897 T464 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 128898 T464 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 128905 T464 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 128905 T464 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 129163 T464 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 129167 T464 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55059
   [junit4]   2> 129168 T464 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 129168 T464 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 129168 T464 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-002
   [junit4]   2> 129169 T464 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-002/'
   [junit4]   2> 129180 T464 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-002/solr.xml
   [junit4]   2> 129232 T464 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-002
   [junit4]   2> 129233 T464 oasc.CoreContainer.<init> New CoreContainer 2974691
   [junit4]   2> 129233 T464 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-002/]
   [junit4]   2> 129234 T464 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 129235 T464 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 129235 T464 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 129235 T464 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 129235 T464 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 129236 T464 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 129236 T464 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 129236 T464 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 129236 T464 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 129237 T464 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 129237 T464 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 129237 T464 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 129238 T464 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52788/solr
   [junit4]   2> 129238 T464 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 129239 T464 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 129240 T484 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@45e67 name:ZooKeeperConnection Watcher:127.0.0.1:52788 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 129241 T464 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 129243 T464 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 129243 T486 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18ae299 name:ZooKeeperConnection Watcher:127.0.0.1:52788/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 129244 T464 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 129245 T464 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 129248 T464 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 129250 T464 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 129252 T464 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 129255 T464 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 129265 T464 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 129267 T464 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55059_lb%2Fz
   [junit4]   2> 129267 T464 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55059_lb%2Fz
   [junit4]   2> 129270 T464 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 129272 T464 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 129276 T464 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:55059_lb%2Fz
   [junit4]   2> 129276 T464 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 129279 T464 oasc.Overseer.start Overseer (id=91739233464483843-127.0.0.1:55059_lb%2Fz-n_0000000000) starting
   [junit4]   2> 129283 T464 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 129291 T488 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 129291 T464 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 129292 T488 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:55059_lb%2Fz
   [junit4]   2> 129294 T464 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 129295 T464 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 129297 T487 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 129299 T464 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-002
   [junit4]   2> 129307 T464 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-002/conf/
   [junit4]   2> 129422 T464 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 129423 T464 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 129423 T464 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 129424 T464 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 129426 T491 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@154c326 name:ZooKeeperConnection Watcher:127.0.0.1:52788/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 129426 T464 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 129428 T464 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 129430 T464 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 129675 T464 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 129676 T464 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 129678 T464 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54770
   [junit4]   2> 129679 T464 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 129679 T464 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 129679 T464 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-003
   [junit4]   2> 129679 T464 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-003/'
   [junit4]   2> 129690 T464 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-003/solr.xml
   [junit4]   2> 129744 T464 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-003
   [junit4]   2> 129744 T464 oasc.CoreContainer.<init> New CoreContainer 28706714
   [junit4]   2> 129745 T464 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-003/]
   [junit4]   2> 129747 T464 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 129747 T464 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 129747 T464 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 129748 T464 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 129748 T464 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 129748 T464 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 129748 T464 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 129749 T464 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 129749 T464 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 129750 T464 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 129750 T464 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 129750 T464 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 129751 T464 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52788/solr
   [junit4]   2> 129751 T464 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 129751 T464 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 129753 T502 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ad4bd6 name:ZooKeeperConnection Watcher:127.0.0.1:52788 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 129753 T464 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 129755 T464 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 129757 T504 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f4b9e0 name:ZooKeeperConnection Watcher:127.0.0.1:52788/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 129757 T464 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 129765 T464 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 130768 T464 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54770_lb%2Fz
   [junit4]   2> 130770 T464 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54770_lb%2Fz
   [junit4]   2> 130773 T491 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 130773 T504 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 130773 T486 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 130779 T464 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-003
   [junit4]   2> 130785 T464 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-003/conf/
   [junit4]   2> 130871 T464 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 130872 T464 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 130872 T464 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 131117 T464 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 131118 T464 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 131120 T464 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:43581
   [junit4]   2> 131120 T464 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 131120 T464 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 131121 T464 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-004
   [junit4]   2> 131121 T464 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-004/'
   [junit4]   2> 131132 T464 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-004/solr.xml
   [junit4]   2> 131179 T464 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-004
   [junit4]   2> 131179 T464 oasc.CoreContainer.<init> New CoreContainer 26211734
   [junit4]   2> 131180 T464 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-004/]
   [junit4]   2> 131181 T464 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 131181 T464 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 131181 T464 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 131182 T464 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 131182 T464 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 131182 T464 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 131182 T464 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 131182 T464 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 131183 T464 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 131183 T464 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 131183 T464 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 131184 T464 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 131184 T464 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52788/solr
   [junit4]   2> 131184 T464 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 131185 T464 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 131186 T516 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4479d0 name:ZooKeeperConnection Watcher:127.0.0.1:52788 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 131187 T464 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 131189 T464 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 131190 T518 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@92cc0d name:ZooKeeperConnection Watcher:127.0.0.1:52788/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 131190 T464 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 131196 T464 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 132198 T464 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43581_lb%2Fz
   [junit4]   2> 132200 T464 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43581_lb%2Fz
   [junit4]   2> 132203 T491 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 132203 T486 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 132203 T504 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 132203 T518 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 132208 T464 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-004
   [junit4]   2> 132215 T464 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-004/conf/
   [junit4]   2> 132324 T464 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 132325 T464 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 132325 T464 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 132581 T464 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 132582 T464 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 132584 T464 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:41627
   [junit4]   2> 132585 T464 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 132585 T464 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 132586 T464 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-005
   [junit4]   2> 132586 T464 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-005/'
   [junit4]   2> 132604 T464 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-005/solr.xml
   [junit4]   2> 132671 T464 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-005
   [junit4]   2> 132672 T464 oasc.CoreContainer.<init> New CoreContainer 27002392
   [junit4]   2> 132672 T464 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-005/]
   [junit4]   2> 132673 T464 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 132673 T464 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 132673 T464 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 132674 T464 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 132674 T464 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 132674 T464 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 132674 T464 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 132675 T464 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 132675 T464 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 132675 T464 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 132676 T464 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 132676 T464 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 132676 T464 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52788/solr
   [junit4]   2> 132676 T464 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 132677 T464 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 132692 T530 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@543248 name:ZooKeeperConnection Watcher:127.0.0.1:52788 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 132692 T464 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 132712 T464 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 132732 T532 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e5d63d name:ZooKeeperConnection Watcher:127.0.0.1:52788/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 132732 T464 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 132833 T464 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 133836 T464 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41627_lb%2Fz
   [junit4]   2> 133838 T464 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41627_lb%2Fz
   [junit4]   2> 133840 T518 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 133840 T504 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 133840 T486 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 133840 T491 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 133840 T532 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 133845 T464 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-005
   [junit4]   2> 133850 T464 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-005/conf/
   [junit4]   2> 133937 T464 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 133939 T464 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 133939 T464 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 134210 T464 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
   [junit4]   2> 134211 T464 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 134213 T464 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60294
   [junit4]   2> 134214 T464 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 134214 T464 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 134214 T464 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-006
   [junit4]   2> 134214 T464 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-006/'
   [junit4]   2> 134226 T464 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-006/solr.xml
   [junit4]   2> 134292 T464 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-006
   [junit4]   2> 134293 T464 oasc.CoreContainer.<init> New CoreContainer 18724150
   [junit4]   2> 134293 T464 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-006/]
   [junit4]   2> 134295 T464 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 134295 T464 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 134296 T464 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 134296 T464 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 134296 T464 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 134297 T464 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 134297 T464 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 134298 T464 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 134298 T464 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 134299 T464 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 134299 T464 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 134300 T464 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 134300 T464 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52788/solr
   [junit4]   2> 134300 T464 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 134301 T464 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 134303 T544 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1640ea6 name:ZooKeeperConnection Watcher:127.0.0.1:52788 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 134303 T464 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 134305 T464 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 134389 T546 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5a48c8 name:ZooKeeperConnection Watcher:127.0.0.1:52788/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 134390 T464 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 134397 T464 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 135399 T464 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60294_lb%2Fz
   [junit4]   2> 135401 T464 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60294_lb%2Fz
   [junit4]   2> 135404 T532 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 135405 T486 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 135405 T504 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 135405 T518 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 135405 T491 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 135405 T546 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 135411 T464 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-006
   [junit4]   2> 135419 T464 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-006/conf/
   [junit4]   2> 135516 T464 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 135517 T464 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 135517 T464 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 135793 T464 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 5
   [junit4]   2> 135794 T464 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 135796 T464 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:44866
   [junit4]   2> 135797 T464 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 135797 T464 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 135798 T464 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-007
   [junit4]   2> 135798 T464 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-007/'
   [junit4]   2> 135820 T464 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-007/solr.xml
   [junit4]   2> 135858 T464 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-007
   [junit4]   2> 135858 T464 oasc.CoreContainer.<init> New CoreContainer 17884967
   [junit4]   2> 135859 T464 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-007/]
   [junit4]   2> 135860 T464 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 135860 T464 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 135860 T464 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 135860 T464 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 135861 T464 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 135861 T464 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 135861 T464 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 135862 T464 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 135862 T464 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 135862 T464 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 135863 T464 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 135863 T464 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 135863 T464 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52788/solr
   [junit4]   2> 135863 T464 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 135864 T464 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 135866 T558 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b7d0c3 name:ZooKeeperConnection Watcher:127.0.0.1:52788 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 135866 T464 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 135868 T464 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 135869 T560 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10da759 name:ZooKeeperConnection Watcher:127.0.0.1:52788/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 135870 T464 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 135876 T464 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 136879 T464 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44866_lb%2Fz
   [junit4]   2> 136880 T464 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44866_lb%2Fz
   [junit4]   2> 136883 T546 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 136883 T504 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 136884 T518 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 136884 T486 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 136884 T491 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 136884 T532 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 136884 T560 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 136888 T464 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-007
   [junit4]   2> 136894 T464 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-007/conf/
   [junit4]   2> 137012 T464 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 137014 T464 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 137014 T464 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 137272 T464 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 6
   [junit4]   2> 137273 T464 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 137275 T464 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:34442
   [junit4]   2> 137276 T464 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 137276 T464 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 137276 T464 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-008
   [junit4]   2> 137276 T464 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-008/'
   [junit4]   2> 137287 T464 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-008/solr.xml
   [junit4]   2> 137324 T464 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-008
   [junit4]   2> 137324 T464 oasc.CoreContainer.<init> New CoreContainer 7466314
   [junit4]   2> 137325 T464 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-008/]
   [junit4]   2> 137326 T464 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 137326 T464 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 137326 T464 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 137326 T464 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 137327 T464 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 137327 T464 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 137327 T464 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 137327 T464 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 137328 T464 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 137328 T464 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 137328 T464 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 137328 T464 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 137329 T464 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52788/solr
   [junit4]   2> 137329 T464 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 137330 T464 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 137331 T572 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@191aa04 name:ZooKeeperConnection Watcher:127.0.0.1:52788 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 137332 T464 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 137334 T464 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 137335 T574 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@679492 name:ZooKeeperConnection Watcher:127.0.0.1:52788/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 137335 T464 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 137343 T464 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 138346 T464 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34442_lb%2Fz
   [junit4]   2> 138347 T464 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34442_lb%2Fz
   [junit4]   2> 138351 T546 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 138351 T532 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 138351 T504 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 138351 T560 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 138351 T518 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 138352 T574 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 138352 T486 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 138352 T491 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 138357 T464 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-008
   [junit4]   2> 138363 T464 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-008/conf/
   [junit4]   2> 138487 T464 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 138488 T464 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 138488 T464 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 138489 T464 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 138491 T577 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17ff285 name:ZooKeeperConnection Watcher:127.0.0.1:52788/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 138491 T464 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 138492 T464 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 138495 T464 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 138496 T579 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e210dc name:ZooKeeperConnection Watcher:127.0.0.1:52788/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 138496 T464 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 138497 T464 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 138502 T570 oasha.CollectionsHandler.handleCreateAction Creating Collection : action=CREATE&replicationFactor=2&maxShardsPerNode=2&name=testOverseerQuit&version=2&wt=javabin&numShards=4
   [junit4]   2> 138504 T486 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 138505 T488 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"testOverseerQuit",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "maxShardsPerNode":"2"}
   [junit4]   2> 138505 T488 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"testOverseerQuit",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "maxShardsPerNode":"2"}
   [junit4]   2> 138506 T488 oasc.OverseerCollectionProcessor.createConfNode Only one config set found in zk - using it:conf1
   [junit4]   2> 138507 T488 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/testOverseerQuit 
   [junit4]   2> 138507 T488 oascc.SolrZkClient.makePath makePath: /collections/testOverseerQuit
   [junit4]   2> 138510 T486 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 138511 T487 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 138512 T487 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: testOverseerQuit
   [junit4]   2> 138512 T487 oasc.Overseer$ClusterStateUpdater.createCollection Create collection testOverseerQuit with shards [shard1, shard2, shard3, shard4]
   [junit4]   2> 138514 T486 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 138515 T577 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 138515 T491 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 138515 T518 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 138515 T532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 138516 T560 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 138515 T579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 138516 T486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 138516 T504 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 138516 T574 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 138516 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 138610 T488 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection, shardNames [shard1, shard2, shard3, shard4] , replicationFactor : 2
   [junit4]   2> 138611 T488 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard1_replica1 as part of slice shard1 of collection testOverseerQuit on 127.0.0.1:44866_lb%2Fz
   [junit4]   2> 138612 T488 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard1_replica2 as part of slice shard1 of collection testOverseerQuit on 127.0.0.1:34442_lb%2Fz
   [junit4]   2> 138613 T488 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard2_replica1 as part of slice shard2 of collection testOverseerQuit on 127.0.0.1:43581_lb%2Fz
   [junit4]   2> 138614 T554 oasha.CoreAdminHandler.handleCreateAction core create command collection.configName=conf1&action=CREATE&qt=/admin/cores&collection=testOverseerQuit&shard=shard1&name=testOverseerQuit_shard1_replica1&version=2&wt=javabin&numShards=4
   [junit4]   2> 138614 T488 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard2_replica2 as part of slice shard2 of collection testOverseerQuit on 127.0.0.1:41627_lb%2Fz
   [junit4]   2> 138615 T569 oasha.CoreAdminHandler.handleCreateAction core create command collection.configName=conf1&action=CREATE&qt=/admin/cores&collection=testOverseerQuit&shard=shard1&name=testOverseerQuit_shard1_replica2&version=2&wt=javabin&numShards=4
   [junit4]   2> 138615 T511 oasha.CoreAdminHandler.handleCreateAction core create command collection.configName=conf1&action=CREATE&qt=/admin/cores&collection=testOverseerQuit&shard=shard2&name=testOverseerQuit_shard2_replica1&version=2&wt=javabin&numShards=4
   [junit4]   2> 138615 T488 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard3_replica1 as part of slice shard3 of collection testOverseerQuit on 127.0.0.1:55059_lb%2Fz
   [junit4]   2> 138616 T488 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard3_replica2 as part of slice shard3 of collection testOverseerQuit on 127.0.0.1:54770_lb%2Fz
   [junit4]   2> 138617 T488 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard4_replica1 as part of slice shard4 of collection testOverseerQuit on 127.0.0.1:60294_lb%2Fz
   [junit4]   2> 138617 T528 oasha.CoreAdminHandler.handleCreateAction core create command collection.configName=conf1&action=CREATE&qt=/admin/cores&collection=testOverseerQuit&shard=shard2&name=testOverseerQuit_shard2_replica2&version=2&wt=javabin&numShards=4
   [junit4]   2> 138617 T481 oasha.CoreAdminHandler.handleCreateAction core create command collection.configName=conf1&action=CREATE&qt=/admin/cores&collection=testOverseerQuit&shard=shard3&name=testOverseerQuit_shard3_replica1&version=2&wt=javabin&numShards=4
   [junit4]   2> 138618 T497 oasha.CoreAdminHandler.handleCreateAction core create command collection.configName=conf1&action=CREATE&qt=/admin/cores&collection=testOverseerQuit&shard=shard3&name=testOverseerQuit_shard3_replica2&version=2&wt=javabin&numShards=4
   [junit4]   2> 138618 T488 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard4_replica2 as part of slice shard4 of collection testOverseerQuit on 127.0.0.1:44866_lb%2Fz
   [junit4]   2> 138618 T569 oasc.ZkController.publish publishing core=testOverseerQuit_shard1_replica2 state=down collection=testOverseerQuit
   [junit4]   2> 138618 T554 oasc.ZkController.publish publishing core=testOverseerQuit_shard1_replica1 state=down collection=testOverseerQuit
   [junit4]   2> 138619 T497 oasc.ZkController.publish publishing core=testOverseerQuit_shard3_replica2 state=down collection=testOverseerQuit
   [junit4]   2> 138620 T486 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 138620 T540 oasha.CoreAdminHandler.handleCreateAction core create command collection.configName=conf1&action=CREATE&qt=/admin/cores&collection=testOverseerQuit&shard=shard4&name=testOverseerQuit_shard4_replica1&version=2&wt=javabin&numShards=4
   [junit4]   2> 138619 T528 oasc.ZkController.publish publishing core=testOverseerQuit_shard2_replica2 state=down collection=testOverseerQuit
   [junit4]   2> 138620 T553 oasha.CoreAdminHandler.handleCreateAction core create command collection.configName=conf1&action=CREATE&qt=/admin/cores&collection=testOverseerQuit&shard=shard4&name=testOverseerQuit_shard4_replica2&version=2&wt=javabin&numShards=4
   [junit4]   2> 138621 T486 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 138619 T511 oasc.ZkController.publish publishing core=testOverseerQuit_shard2_replica1 state=down collection=testOverseerQuit
   [junit4]   2> 138619 T481 oasc.ZkController.publish publishing core=testOverseerQuit_shard3_replica1 state=down collection=testOverseerQuit
   [junit4]   2> 138621 T554 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 138620 T497 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 138620 T569 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 138622 T540 oasc.ZkController.publish publishing core=testOverseerQuit_shard4_replica1 state=down collection=testOverseerQuit
   [junit4]   2> 138622 T481 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 138622 T511 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 138622 T528 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 138622 T487 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 138623 T540 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 138623 T553 oasc.ZkController.publish publishing core=testOverseerQuit_shard4_replica2 state=down collection=testOverseerQuit
   [junit4]   2> 138624 T487 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:34442/lb/z",
   [junit4]   2> 	  "core":"testOverseerQuit_shard1_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:34442_lb%2Fz",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"testOverseerQuit",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 138625 T553 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 138627 T487 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:54770/lb/z",
   [junit4]   2> 	  "core":"testOverseerQuit_shard3_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:54770_lb%2Fz",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "collection":"testOverseerQuit",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 138630 T486 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 138630 T487 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:44866/lb/z",
   [junit4]   2> 	  "core":"testOverseerQuit_shard1_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:44866_lb%2Fz",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"testOverseerQuit",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 138633 T486 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 138634 T487 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:41627/lb/z",
   [junit4]   2> 	  "core":"testOverseerQuit_shard2_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:41627_lb%2Fz",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"testOverseerQuit",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 138636 T486 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 138637 T487 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:43581/lb/z",
   [junit4]   2> 	  "core":"testOverseerQuit_shard2_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:43581_lb%2Fz",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"testOverseerQuit",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 138639 T486 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 138639 T487 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55059/lb/z",
   [junit4]   2> 	  "core":"testOverseerQuit_shard3_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55059_lb%2Fz",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "collection":"testOverseerQuit",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 138641 T486 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 138642 T487 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:60294/lb/z",
   [junit4]   2> 	  "core":"testOverseerQuit_shard4_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:60294_lb%2Fz",
   [junit4]   2> 	  "shard":"shard4",
   [junit4]   2> 	  "collection":"testOverseerQuit",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 138644 T486 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 138645 T487 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:44866/lb/z",
   [junit4]   2> 	  "core":"testOverseerQuit_shard4_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:44866_lb%2Fz",
   [junit4]   2> 	  "shard":"shard4",
   [junit4]   2> 	  "collection":"testOverseerQuit",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 138646 T486 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 138750 T491 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 138751 T560 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 138751 T504 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 138751 T532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 138750 T579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 138750 T518 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 138750 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 138750 T574 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 138750 T577 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 138751 T486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 139622 T554 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard1_replica1
   [junit4]   2> 139622 T497 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard3_replica2
   [junit4]   2> 139622 T569 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard1_replica2
   [junit4]   2> 139623 T481 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard3_replica1
   [junit4]   2> 139623 T497 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
   [junit4]   2> 139623 T554 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
   [junit4]   2> 139623 T511 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard2_replica1
   [junit4]   2> 139624 T481 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
   [junit4]   2> 139624 T540 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard4_replica1
   [junit4]   2> 139625 T511 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
   [junit4]   2> 139623 T569 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
   [junit4]   2> 139623 T528 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard2_replica2
   [junit4]   2> 139625 T553 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard4_replica2
   [junit4]   2> 139625 T540 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
   [junit4]   2> 139625 T481 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 139624 T554 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 139624 T497 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 139627 T497 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
   [junit4]   2> 139627 T554 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
   [junit4]   2> 139627 T540 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 139628 T540 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
   [junit4]   2> 139627 T511 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 139627 T553 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
   [junit4]   2> 139627 T481 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
   [junit4]   2> 139629 T540 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 139626 T528 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
   [junit4]   2> 139626 T569 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 139629 T540 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-006/testOverseerQuit_shard4_replica1/'
   [junit4]   2> 139630 T481 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 139629 T553 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 139630 T553 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
   [junit4]   2> 139629 T554 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 139631 T554 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-007/testOverseerQuit_shard1_replica1/'
   [junit4]   2> 139629 T497 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 139628 T511 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
   [junit4]   2> 139631 T497 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-003/testOverseerQuit_shard3_replica2/'
   [junit4]   2> 139630 T481 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-002/testOverseerQuit_shard3_replica1/'
   [junit4]   2> 139630 T528 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 139633 T528 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
   [junit4]   2> 139630 T569 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
   [junit4]   2> 139633 T511 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 139634 T511 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-004/testOverseerQuit_shard2_replica1/'
   [junit4]   2> 139632 T553 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 139635 T553 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-007/testOverseerQuit_shard4_replica2/'
   [junit4]   2> 139652 T528 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 139652 T569 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 139652 T528 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-005/testOverseerQuit_shard2_replica2/'
   [junit4]   2> 139654 T569 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-008/testOverseerQuit_shard1_replica2/'
   [junit4]   2> 139745 T540 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
   [junit4]   2> 139754 T481 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
   [junit4]   2> 139771 T553 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
   [junit4]   2> 139784 T511 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
   [junit4]   2> 139785 T554 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
   [junit4]   2> 139793 T497 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
   [junit4]   2> 139794 T569 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
   [junit4]   2> 139836 T528 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
   [junit4]   2> 139881 T540 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 139887 T540 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 139896 T497 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 139899 T540 oass.IndexSchema.readSchema [testOverseerQuit_shard4_replica1] Schema name=test
   [junit4]   2> 139900 T497 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 139918 T554 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 139919 T497 oass.IndexSchema.readSchema [testOverseerQuit_shard3_replica2] Schema name=test
   [junit4]   2> 139924 T553 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 139925 T481 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 139927 T481 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 139934 T553 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 139938 T554 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 139955 T569 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 139957 T481 oass.IndexSchema.readSchema [testOverseerQuit_shard3_replica1] Schema name=test
   [junit4]   2> 139961 T554 oass.IndexSchema.readSchema [testOverseerQuit_shard1_replica1] Schema name=test
   [junit4]   2> 139961 T553 oass.IndexSchema.readSchema [testOverseerQuit_shard4_replica2] Schema name=test
   [junit4]   2> 139961 T569 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 139969 T511 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 139971 T528 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 139973 T569 oass.IndexSchema.readSchema [testOverseerQuit_shard1_replica2] Schema name=test
   [junit4]   2> 139974 T511 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 139975 T528 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 139999 T511 oass.IndexSchema.readSchema [testOverseerQuit_shard2_replica1] Schema name=test
   [junit4]   2> 140002 T528 oass.IndexSchema.readSchema [testOverseerQuit_shard2_replica2] Schema name=test
   [junit4]   2> 140954 T540 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 140956 T540 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 140957 T540 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 140975 T540 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 140979 T540 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 140995 T569 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 140995 T569 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 140996 T569 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 140998 T553 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 140998 T553 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 140999 T553 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 141005 T569 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 141009 T569 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 141009 T553 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 141020 T553 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 141025 T540 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 141028 T497 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 141028 T497 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 141029 T497 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 141029 T554 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 141029 T540 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 141030 T554 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 141031 T554 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 141035 T540 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 141036 T569 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 141036 T540 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 141037 T540 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 141037 T540 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 141038 T497 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 141039 T540 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 141039 T540 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 141040 T540 oasc.CoreContainer.create Creating SolrCore 'testOverseerQuit_shard4_replica1' using configuration from collection testOverseerQuit
   [junit4]   2> 141040 T540 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 141041 T540 oasc.SolrCore.<init> [testOverseerQuit_shard4_replica1] Opening new SolrCore at ./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-006/testOverseerQuit_shard4_replica1/, dataDir=./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-006/testOverseerQuit_shard4_replica1/data/
   [junit4]   2> 141041 T540 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1df1f78
   [junit4]   2> 141042 T540 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-006/testOverseerQuit_shard4_replica1/data
   [junit4]   2> 141043 T540 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-006/testOverseerQuit_shard4_replica1/data/index/
   [junit4]   2> 141043 T540 oasc.SolrCore.initIndex WARN [testOverseerQuit_shard4_replica1] Solr index directory './solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-006/testOverseerQuit_shard4_replica1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 141053 T569 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 141053 T497 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 141055 T554 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 141056 T540 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-006/testOverseerQuit_shard4_replica1/data/index
   [junit4]   2> 141056 T540 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=11, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=23.240234375, floorSegmentMB=0.837890625, forceMergeDeletesPctAllowed=18.760376038473073, segmentsPerTier=21.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 141058 T540 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDi

[...truncated too long message...]

nc WARN Closed, skipping sync up.
   [junit4]   2> 170221 T560 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 170221 T560 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:44866/lb/z/testOverseerQuit_shard4_replica2/ shard4
   [junit4]   2> 170221 T560 oasc.SolrCore.close [testOverseerQuit_shard4_replica2]  CLOSING SolrCore org.apache.solr.core.SolrCore@10a0655
   [junit4]   2> 170228 T560 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
   [junit4]   2> 170228 T560 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 170229 T560 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 170229 T560 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 170229 T560 oasc.SolrCore.closeSearcher [testOverseerQuit_shard4_replica2] Closing main searcher on request.
   [junit4]   2> 170230 T560 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 170230 T560 oasc.CachingDirectoryFactory.closeCacheValue looking to close ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-007/testOverseerQuit_shard4_replica2/data [CachedDir<<refCount=0;path=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-007/testOverseerQuit_shard4_replica2/data;done=false>>]
   [junit4]   2> 170230 T560 oasc.CachingDirectoryFactory.close Closing directory: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-007/testOverseerQuit_shard4_replica2/data
   [junit4]   2> 170230 T560 oasc.CachingDirectoryFactory.closeCacheValue looking to close ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-007/testOverseerQuit_shard4_replica2/data/index [CachedDir<<refCount=0;path=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-007/testOverseerQuit_shard4_replica2/data/index;done=false>>]
   [junit4]   2> 170230 T560 oasc.CachingDirectoryFactory.close Closing directory: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001/tempDir-007/testOverseerQuit_shard4_replica2/data/index
   [junit4]   2> 170230 T560 oascc.SolrZkClient.makePath makePath: /collections/testOverseerQuit/leaders/shard4
   [junit4]   2> 170231 T560 oasc.SolrException.log ERROR There was a problem trying to register as the leader:org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:136)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:291)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:142)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:110)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 	Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
   [junit4]   2> 		at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:123)
   [junit4]   2> 		... 7 more
   [junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 		at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:209)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:206)
   [junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:206)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:417)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:386)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:373)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:128)
   [junit4]   2> 		at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
   [junit4]   2> 		... 8 more
   [junit4]   2> 	
   [junit4]   2> 170231 T560 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 170232 T560 oasc.LeaderElector$ElectionWatcher.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/testOverseerCol/leader_elect/shard2/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-6062E6A9467F40E3-001
   [junit4]   2> NOTE: test params are: codec=Lucene45, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ca, timezone=GMT
   [junit4]   2> NOTE: Linux 3.8.0-39-generic i386/Oracle Corporation 1.7.0_55 (32-bit)/cpus=8,threads=1,free=49283056,total=161419264
   [junit4]   2> NOTE: All tests run in this JVM: [MoreLikeThisHandlerTest, TestDefaultSearchFieldResource, ShowFileRequestHandlerTest, SystemInfoHandlerTest, SyncSliceTest, SearchHandlerTest, CircularListTest, UUIDFieldTest, SoftAutoCommitTest, TestDistributedMissingSort, SpellPossibilityIteratorTest, ReturnFieldsTest, SimpleFacetsTest, CSVRequestHandlerTest, TestRealTimeGet, URLClassifyProcessorTest, OverseerRolesTest]
   [junit4] Completed on J0 in 41.74s, 1 test, 1 failure <<< FAILURES!

[...truncated 1090 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/lucene/common-build.xml:1293: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/lucene/common-build.xml:919: There were test failures: 387 suites, 1624 tests, 1 failure, 37 ignored (16 assumptions)

Total time: 56 minutes 57 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_55 -server -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure