You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/05/07 23:54:02 UTC
[JENKINS] Lucene-Solr-4.8-Linux (64bit/jdk1.8.0_20-ea-b11) - Build
# 125 - Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.8-Linux/125/
Java: 64bit/jdk1.8.0_20-ea-b11 -XX:-UseCompressedOops -XX:+UseSerialGC
2 tests failed.
FAILED: org.apache.solr.cloud.AliasIntegrationTest.testDistribSearch
Error Message:
createcollection the collection error [Watcher fired on path: null state: SyncConnected type None]
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: createcollection the collection error [Watcher fired on path: null state: SyncConnected type None]
at __randomizedtesting.SeedInfo.seed([62CA9D5FF6559D20:E32C1347810AFD1C]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:554)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1655)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1615)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1675)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1611)
at org.apache.solr.cloud.AliasIntegrationTest.doTest(AliasIntegrationTest.java:91)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
at sun.reflect.GeneratedMethodAccessor42.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
Error Message:
No registered leader was found after waiting for 30000ms , collection: collection1 slice: shard1
Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found after waiting for 30000ms , collection: collection1 slice: shard1
at __randomizedtesting.SeedInfo.seed([62CA9D5FF6559D20:3CFE5011B52A01C7]:0)
at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:545)
at org.apache.solr.cloud.LeaderElectionIntegrationTest.getLeader(LeaderElectionIntegrationTest.java:255)
at org.apache.solr.cloud.LeaderElectionIntegrationTest.testSimpleSliceLeaderElection(LeaderElectionIntegrationTest.java:179)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11093 lines...]
[junit4] Suite: org.apache.solr.cloud.LeaderElectionIntegrationTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.LeaderElectionIntegrationTest-62CA9D5FF6559D20-001/init-core-data-001
[junit4] 2> 795890 T3795 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 795892 T3795 oas.SolrTestCaseJ4.setUp ###Starting testLeaderElectionAfterClientTimeout
[junit4] 2> 795893 T3795 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 795893 T3796 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 795993 T3795 oasc.ZkTestServer.run start zk server on port:60691
[junit4] 2> 795995 T3795 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 796235 T3802 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2e6fc86d name:ZooKeeperConnection Watcher:127.0.0.1:60691 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 796236 T3795 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 796237 T3795 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 796239 T3795 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 796242 T3804 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f1468f name:ZooKeeperConnection Watcher:127.0.0.1:60691/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 796242 T3795 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 796242 T3795 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 796245 T3795 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 796246 T3795 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 796247 T3795 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 796248 T3795 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 796249 T3795 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 796251 T3795 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 796251 T3795 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 796252 T3795 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 796253 T3795 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 796254 T3795 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 796255 T3795 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 796256 T3795 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 796256 T3795 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 796258 T3795 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 796259 T3795 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 796260 T3795 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 796261 T3795 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 796262 T3795 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 796262 T3795 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 796263 T3795 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 796263 T3795 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 796265 T3795 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 796265 T3795 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 796266 T3795 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 796266 T3795 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 796268 T3795 oasc.LeaderElectionIntegrationTest.setUp ####SETUP_START testLeaderElectionAfterClientTimeout
[junit4] 2> 796268 T3795 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 796269 T3795 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr
[junit4] 2> 796269 T3795 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/'
[junit4] 2> 796279 T3795 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/solr.xml
[junit4] 2> 796287 T3795 oasc.CoreContainer.<init> New CoreContainer 806536959
[junit4] 2> 796288 T3795 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/]
[junit4] 2> 796288 T3795 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 796288 T3795 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: https
[junit4] 2> 796288 T3795 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 796289 T3795 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 796289 T3795 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 796289 T3795 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 796289 T3795 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 796289 T3795 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 796289 T3795 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 796291 T3795 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 796291 T3795 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 796292 T3795 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 796292 T3795 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60691/solr
[junit4] 2> 796292 T3795 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 796292 T3795 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 796294 T3806 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6471ad3f name:ZooKeeperConnection Watcher:127.0.0.1:60691 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 796294 T3795 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 796296 T3795 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 796296 T3808 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a500cd3 name:ZooKeeperConnection Watcher:127.0.0.1:60691/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 796297 T3795 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 796297 T3795 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 796299 T3795 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 796301 T3795 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 796303 T3795 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 796304 T3795 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 796305 T3795 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 796306 T3795 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:7000_solr
[junit4] 2> 796306 T3795 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:7000_solr
[junit4] 2> 796307 T3795 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 796308 T3795 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 796312 T3795 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:7000_solr
[junit4] 2> 796312 T3795 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 796314 T3795 oasc.Overseer.start Overseer (id=91717566377951235-127.0.0.1:7000_solr-n_0000000000) starting
[junit4] 2> 796316 T3795 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 796322 T3810 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 796322 T3795 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 796322 T3810 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:7000_solr
[junit4] 2> 796323 T3795 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 796323 T3795 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 796325 T3809 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 796326 T3811 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 796326 T3811 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 796327 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 796327 T3811 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 796327 T3809 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 796328 T3809 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:7000/solr",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:7000_solr",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":null,
[junit4] 2> "core_node_name":null}
[junit4] 2> 796329 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 796329 T3808 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 797327 T3811 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 797327 T3811 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 797328 T3811 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 797328 T3811 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 797329 T3811 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 797329 T3811 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/'
[junit4] 2> 797329 T3811 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
[junit4] 2> 797329 T3811 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
[junit4] 2> 797330 T3811 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/lib/README' to classloader
[junit4] 2> 797353 T3811 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 797387 T3811 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 797389 T3811 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 797393 T3811 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 797514 T3811 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 797515 T3811 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 797515 T3811 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 797518 T3811 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 797520 T3811 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 797530 T3811 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 797532 T3811 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 797534 T3811 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 797535 T3811 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 797535 T3811 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 797535 T3811 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 797536 T3811 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 797536 T3811 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 797536 T3811 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 797536 T3811 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 797536 T3811 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.LeaderElectionIntegrationTest-62CA9D5FF6559D20-001/tempDir-001/
[junit4] 2> 797536 T3811 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6015abe4
[junit4] 2> 797537 T3811 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.LeaderElectionIntegrationTest-62CA9D5FF6559D20-001/tempDir-001
[junit4] 2> 797537 T3811 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.LeaderElectionIntegrationTest-62CA9D5FF6559D20-001/tempDir-001/index/
[junit4] 2> 797537 T3811 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.LeaderElectionIntegrationTest-62CA9D5FF6559D20-001/tempDir-001/index' doesn't exist. Creating new index...
[junit4] 2> 797537 T3811 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.LeaderElectionIntegrationTest-62CA9D5FF6559D20-001/tempDir-001/index
[junit4] 2> 797538 T3811 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=97.2900390625, floorSegmentMB=1.5546875, forceMergeDeletesPctAllowed=18.13765330268211, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 797538 T3811 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@3f2f1075 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@411910d)),segFN=segments_1,generation=1}
[junit4] 2> 797538 T3811 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 797539 T3811 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4] 2> 797540 T3811 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 797540 T3811 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 797541 T3811 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 797541 T3811 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 797541 T3811 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 797541 T3811 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 797541 T3811 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
[junit4] 2> 797541 T3811 oasup.UniqFieldsUpdateProcessorFactory.init WARN Use of the 'fields' init param in UniqFieldsUpdateProcessorFactory is deprecated, please use 'fieldName' (or another FieldMutatingUpdateProcessorFactory selector option) instead
[junit4] 2> 797541 T3811 oasup.UniqFieldsUpdateProcessorFactory.init Replacing 'fields' init param with (individual) 'fieldName' params
[junit4] 2> 797542 T3811 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4] 2> 797542 T3811 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 797542 T3811 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 797542 T3811 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 797542 T3811 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 797542 T3811 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 797543 T3811 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 797543 T3811 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 797543 T3811 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 797543 T3811 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4] 2> 797543 T3811 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4] 2> 797544 T3811 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 797544 T3811 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 797544 T3811 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 797544 T3811 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 797544 T3811 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 797545 T3811 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 797545 T3811 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 797545 T3811 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 797545 T3811 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 797545 T3811 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 797545 T3811 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 797546 T3811 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 797546 T3811 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 797546 T3811 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 797546 T3811 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4] 2> 797546 T3811 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4] 2> 797548 T3811 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 797549 T3811 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4] 2> 797550 T3811 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 797550 T3811 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 797550 T3811 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=18.19140625, floorSegmentMB=1.57421875, forceMergeDeletesPctAllowed=26.155137415632876, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 797550 T3811 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@3f2f1075 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@411910d)),segFN=segments_1,generation=1}
[junit4] 2> 797551 T3811 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 797551 T3811 oass.SolrIndexSearcher.<init> Opening Searcher@4e332391[collection1] main
[junit4] 2> 797551 T3811 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 797552 T3811 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 797552 T3811 oasr.RestManager.init Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
[junit4] 2> 797552 T3811 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
[junit4] 2> 797552 T3811 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 797553 T3811 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 797553 T3811 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 797553 T3811 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4] 2> 797557 T3811 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 797576 T3812 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4e332391[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 797578 T3811 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 797578 T3815 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:7000/solr collection:collection1 shard:shard1
[junit4] 2> 797579 T3815 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 797580 T3795 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 797580 T3795 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr
[junit4] 2> 797580 T3795 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/'
[junit4] 2> 797584 T3815 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 797585 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 797586 T3815 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 797586 T3815 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 797586 T3815 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:7000/solr/collection1/ shard1
[junit4] 2> 797586 T3809 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 797586 T3815 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 797588 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 797589 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 797590 T3795 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/solr.xml
[junit4] 2> 797592 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 797606 T3795 oasc.CoreContainer.<init> New CoreContainer 1840533829
[junit4] 2> 797607 T3795 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/]
[junit4] 2> 797607 T3795 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 797607 T3795 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: https
[junit4] 2> 797607 T3795 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 797607 T3795 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 797608 T3795 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 797608 T3795 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 797608 T3795 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 797608 T3795 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 797608 T3795 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 797610 T3795 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 797610 T3795 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 797610 T3795 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 797610 T3795 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60691/solr
[junit4] 2> 797611 T3795 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 797611 T3795 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 797613 T3817 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24f48705 name:ZooKeeperConnection Watcher:127.0.0.1:60691 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 797613 T3795 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 797614 T3795 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 797615 T3819 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d83344c name:ZooKeeperConnection Watcher:127.0.0.1:60691/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 797615 T3795 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 797619 T3795 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 797693 T3808 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 797693 T3819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 797740 T3815 oasc.ZkController.register We are http://127.0.0.1:7000/solr/collection1/ and leader is http://127.0.0.1:7000/solr/collection1/
[junit4] 2> 797740 T3815 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:7000/solr
[junit4] 2> 797740 T3815 oasc.ZkController.checkRecovery WARN Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4] 2> 797740 T3815 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 797740 T3815 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 797741 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 797741 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 797741 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 797742 T3815 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 797742 T3809 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 797742 T3809 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:7000/solr",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:7000_solr",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":null,
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 797744 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 797851 T3819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 797851 T3808 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 798620 T3795 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:7001_solr
[junit4] 2> 798621 T3795 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:7001_solr
[junit4] 2> 798623 T3819 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 798623 T3808 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 798625 T3820 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 798625 T3820 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 798626 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 798626 T3820 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 798626 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 798626 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 798627 T3809 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 798627 T3809 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:7001/solr",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:7001_solr",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":null,
[junit4] 2> "core_node_name":null}
[junit4] 2> 798629 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 798731 T3819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 798731 T3808 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 799626 T3820 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 799627 T3820 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 799627 T3820 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 799627 T3820 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 799628 T3820 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 799628 T3820 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/'
[junit4] 2> 799629 T3820 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
[junit4] 2> 799629 T3820 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
[junit4] 2> 799629 T3820 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/lib/README' to classloader
[junit4] 2> 799651 T3820 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 799676 T3820 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 799677 T3820 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 799681 T3820 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 799801 T3820 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 799802 T3820 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 799802 T3820 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 799805 T3820 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 799806 T3820 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 799813 T3820 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 799815 T3820 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 799816 T3820 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 799817 T3820 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 799817 T3820 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 799817 T3820 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 799817 T3820 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 799817 T3820 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 799818 T3820 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 799818 T3820 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 799818 T3820 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.LeaderElectionIntegrationTest-62CA9D5FF6559D20-001/tempDir-002/
[junit4] 2> 799818 T3820 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6015abe4
[junit4] 2> 799819 T3820 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.LeaderElectionIntegrationTest-62CA9D5FF6559D20-001/tempDir-002
[junit4] 2> 799819 T3820 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.LeaderElectionIntegrationTest-62CA9D5FF6559D20-001/tempDir-002/index/
[junit4] 2> 799819 T3820 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.LeaderElectionIntegrationTest-62CA9D5FF6559D20-001/tempDir-002/index' doesn't exist. Creating new index...
[junit4] 2> 799819 T3820 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.LeaderElectionIntegrationTest-62CA9D5FF6559D20-001/tempDir-002/index
[junit4] 2> 799820 T3820 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=97.2900390625, floorSegmentMB=1.5546875, forceMergeDeletesPctAllowed=18.13765330268211, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 799820 T3820 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@7543192f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6cfd0c23)),segFN=segments_1,generation=1}
[junit4] 2> 799820 T3820 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 799821 T3820 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4] 2> 799822 T3820 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 799823 T3820 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 799823 T3820 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 799823 T3820 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 799823 T3820 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 799823 T3820 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 799823 T3820 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
[junit4] 2> 799823 T3820 oasup.UniqFieldsUpdateProcessorFactory.init WARN Use of the 'fields' init param in UniqFieldsUpdateProcessorFactory is deprecated, please use 'fieldName' (or another FieldMutatingUpdateProcessorFactory selector option) instead
[junit4] 2> 799824 T3820 oasup.UniqFieldsUpdateProcessorFactory.init Replacing 'fields' init param with (individual) 'fieldName' params
[junit4] 2> 799824 T3820 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4] 2> 799824 T3820 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 799824 T3820 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 799824 T3820 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 799824 T3820 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 799825 T3820 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 799825 T3820 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 799825 T3820 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 799834 T3820 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 799834 T3820 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4] 2> 799834 T3820 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4] 2> 799835 T3820 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 799835 T3820 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 799835 T3820 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 799835 T3820 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 799836 T3820 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 799836 T3820 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 799836 T3820 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 799836 T3820 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 799837 T3820 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 799837 T3820 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 799837 T3820 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 799837 T3820 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 799838 T3820 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 799838 T3820 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 799838 T3820 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4] 2> 799838 T3820 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4] 2> 799839 T3820 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 799840 T3820 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4] 2> 799841 T3820 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 799841 T3820 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 799842 T3820 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=18.19140625, floorSegmentMB=1.57421875, forceMergeDeletesPctAllowed=26.155137415632876, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 799842 T3820 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@7543192f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6cfd0c23)),segFN=segments_1,generation=1}
[junit4] 2> 799842 T3820 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 799842 T3820 oass.SolrIndexSearcher.<init> Opening Searcher@1028a0b3[collection1] main
[junit4] 2> 799842 T3820 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 799843 T3820 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 799844 T3820 oasr.RestManager.init Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
[junit4] 2> 799844 T3820 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
[junit4] 2> 799844 T3820 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 799844 T3820 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 799844 T3820 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 799844 T3820 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4] 2> 799848 T3820 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 799864 T3821 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1028a0b3[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 799866 T3820 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 799867 T3824 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:7001/solr collection:collection1 shard:shard1
[junit4] 2> 799868 T3795 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 799868 T3795 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr
[junit4] 2> 799868 T3795 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/'
[junit4] 2> 799869 T3824 oasc.ZkController.register We are http://127.0.0.1:7001/solr/collection1/ and leader is http://127.0.0.1:7000/solr/collection1/
[junit4] 2> 799869 T3824 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:7001/solr
[junit4] 2> 799869 T3824 oasc.ZkController.checkRecovery WARN Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4] 2> 799869 T3824 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 799869 T3824 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 799870 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 799870 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 799870 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 799870 T3824 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 799871 T3809 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 799871 T3809 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:7001/solr",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:7001_solr",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":null,
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 799872 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 799879 T3795 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/solr.xml
[junit4] 2> 799886 T3795 oasc.CoreContainer.<init> New CoreContainer 528553343
[junit4] 2> 799887 T3795 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/]
[junit4] 2> 799887 T3795 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 799887 T3795 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: https
[junit4] 2> 799887 T3795 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 799887 T3795 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 799888 T3795 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 799888 T3795 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 799888 T3795 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 799888 T3795 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 799888 T3795 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 799890 T3795 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 799890 T3795 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 799890 T3795 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 799890 T3795 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60691/solr
[junit4] 2> 799890 T3795 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 799891 T3795 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 799892 T3826 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@abe1d78 name:ZooKeeperConnection Watcher:127.0.0.1:60691 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 799892 T3795 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 799893 T3795 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 799894 T3828 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@541bbe52 name:ZooKeeperConnection Watcher:127.0.0.1:60691/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 799894 T3795 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 799898 T3795 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 799976 T3819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 799976 T3808 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 799976 T3828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 800900 T3795 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:7002_solr
[junit4] 2> 800901 T3795 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:7002_solr
[junit4] 2> 800902 T3808 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 800902 T3828 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 800902 T3819 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 800906 T3829 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 800906 T3829 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 800907 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 800907 T3829 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 800907 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 800907 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 800908 T3809 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 800908 T3809 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:7002/solr",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:7002_solr",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":null,
[junit4] 2> "core_node_name":null}
[junit4] 2> 800909 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 801011 T3819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 801011 T3828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 801011 T3808 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 801907 T3829 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 801907 T3829 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 801908 T3829 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 801908 T3829 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 801909 T3829 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 801909 T3829 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/'
[junit4] 2> 801909 T3829 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
[junit4] 2> 801909 T3829 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
[junit4] 2> 801909 T3829 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/lib/README' to classloader
[junit4] 2> 801932 T3829 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 801965 T3829 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 801967 T3829 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 801970 T3829 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 802110 T3829 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 802111 T3829 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 802111 T3829 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 802115 T3829 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 802116 T3829 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 802123 T3829 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 802126 T3829 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 802128 T3829 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 802129 T3829 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 802129 T3829 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 802130 T3829 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 802130 T3829 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 802131 T3829 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 802131 T3829 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 802131 T3829 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 802131 T3829 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.LeaderElectionIntegrationTest-62CA9D5FF6559D20-001/tempDir-003/
[junit4] 2> 802132 T3829 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6015abe4
[junit4] 2> 802132 T3829 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.LeaderElectionIntegrationTest-62CA9D5FF6559D20-001/tempDir-003
[junit4] 2> 802132 T3829 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.LeaderElectionIntegrationTest-62CA9D5FF6559D20-001/tempDir-003/index/
[junit4] 2> 802133 T3829 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.LeaderElectionIntegrationTest-62CA9D5FF6559D20-001/tempDir-003/index' doesn't exist. Creating new index...
[junit4] 2> 802133 T3829 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.LeaderElectionIntegrationTest-62CA9D5FF6559D20-001/tempDir-003/index
[junit4] 2> 802133 T3829 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=97.2900390625, floorSegmentMB=1.5546875, forceMergeDeletesPctAllowed=18.13765330268211, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 802134 T3829 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@54ea7def lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@141785dc)),segFN=segments_1,generation=1}
[junit4] 2> 802134 T3829 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 802135 T3829 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4] 2> 802138 T3829 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 802138 T3829 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 802138 T3829 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 802139 T3829 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 802139 T3829 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 802139 T3829 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 802139 T3829 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
[junit4] 2> 802139 T3829 oasup.UniqFieldsUpdateProcessorFactory.init WARN Use of the 'fields' init param in UniqFieldsUpdateProcessorFactory is deprecated, please use 'fieldName' (or another FieldMutatingUpdateProcessorFactory selector option) instead
[junit4] 2> 802140 T3829 oasup.UniqFieldsUpdateProcessorFactory.init Replacing 'fields' init param with (individual) 'fieldName' params
[junit4] 2> 802140 T3829 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4] 2> 802140 T3829 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 802141 T3829 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 802141 T3829 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 802141 T3829 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 802141 T3829 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 802141 T3829 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 802142 T3829 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 802142 T3829 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 802143 T3829 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4] 2> 802143 T3829 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4] 2> 802144 T3829 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 802144 T3829 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 802144 T3829 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 802145 T3829 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 802145 T3829 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 802145 T3829 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 802146 T3829 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 802146 T3829 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 802146 T3829 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 802147 T3829 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 802147 T3829 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 802148 T3829 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 802148 T3829 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 802148 T3829 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 802149 T3829 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4] 2> 802149 T3829 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4] 2> 802151 T3829 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 802152 T3829 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4] 2> 802154 T3829 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 802154 T3829 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 802155 T3829 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=18.19140625, floorSegmentMB=1.57421875, forceMergeDeletesPctAllowed=26.155137415632876, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 802155 T3829 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@54ea7def lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@141785dc)),segFN=segments_1,generation=1}
[junit4] 2> 802156 T3829 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 802156 T3829 oass.SolrIndexSearcher.<init> Opening Searcher@4a5d03e7[collection1] main
[junit4] 2> 802156 T3829 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 802157 T3829 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 802157 T3829 oasr.RestManager.init Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
[junit4] 2> 802157 T3829 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
[junit4] 2> 802157 T3829 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 802158 T3829 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 802158 T3829 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 802158 T3829 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4] 2> 802175 T3829 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 802195 T3830 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4a5d03e7[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 802199 T3829 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 802200 T3833 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:7002/solr collection:collection1 shard:shard1
[junit4] 2> 802201 T3795 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 802201 T3795 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr
[junit4] 2> 802201 T3795 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/'
[junit4] 2> 802201 T3833 oasc.ZkController.register We are http://127.0.0.1:7002/solr/collection1/ and leader is http://127.0.0.1:7000/solr/collection1/
[junit4] 2> 802202 T3833 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:7002/solr
[junit4] 2> 802202 T3833 oasc.ZkController.checkRecovery WARN Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4] 2> 802202 T3833 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 802202 T3833 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 802203 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 802203 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 802203 T3833 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 802203 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 802204 T3809 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 802204 T3809 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:7002/solr",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:7002_solr",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":null,
[junit4] 2> "core_node_name":"core_node3"}
[junit4] 2> 802205 T3808 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 802210 T3795 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/solr.xml
[junit4] 2> 802218 T3795 oasc.CoreContainer.<init> New CoreContainer 1040249819
[junit4] 2> 802218 T3795 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/]
[junit4] 2> 802218 T3795 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 802218 T3795 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: https
[junit4] 2> 802219 T3795 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 802219 T3795 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 802219 T3795 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 802219 T3795 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 802219 T3795 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 802219 T3795 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 802220 T3795 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 802221 T3795 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 802221 T3795 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 802221 T3795 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 802222 T3795 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60691/solr
[junit4] 2> 802222 T3795 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 802222 T3795 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 802224 T3835 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6a6c3af4 name:ZooKeeperConnection Watcher:127.0.0.1:60691 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 802224 T3795 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 802225 T3795 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 802226 T3837 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3ffc9211 name:ZooKeeperConnection Watcher:127.0.0.1:60691/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 802226 T3795 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 802231 T3795 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 802308 T3819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 802308 T3828 oascc.ZkStateReader
[...truncated too long message...]
[junit4] 2> 1086366 T5323 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@6f33ef83
[junit4] 2> 1086371 T5323 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=1,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
[junit4] 2> 1086371 T5323 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 1086371 T5323 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 1086371 T5323 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 1086371 T5323 C2643 P41166 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@5f443962 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5db01cb4),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@5f443962 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5db01cb4),segFN=segments_2,generation=2}
[junit4] 2> 1086372 T5323 C2643 P41166 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4] 2> 1086372 T5323 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 1086373 T5323 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 1086373 T5323 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solr.cloud.AliasIntegrationTest-62CA9D5FF6559D20-001/tempDir-001/jetty4/index [CachedDir<<refCount=0;path=./solr.cloud.AliasIntegrationTest-62CA9D5FF6559D20-001/tempDir-001/jetty4/index;done=false>>]
[junit4] 2> 1086373 T5323 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.AliasIntegrationTest-62CA9D5FF6559D20-001/tempDir-001/jetty4/index
[junit4] 2> 1086373 T5323 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solr.cloud.AliasIntegrationTest-62CA9D5FF6559D20-001/tempDir-001/jetty4 [CachedDir<<refCount=0;path=./solr.cloud.AliasIntegrationTest-62CA9D5FF6559D20-001/tempDir-001/jetty4;done=false>>]
[junit4] 2> 1086373 T5323 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.AliasIntegrationTest-62CA9D5FF6559D20-001/tempDir-001/jetty4
[junit4] 2> 1086373 T5323 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1086374 T5323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1086374 T5323 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1086374 T5323 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1086374 T5323 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1086374 T5323 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1086375 T5323 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1086375 T5323 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1086375 T5323 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.AliasIntegrationTest-62CA9D5FF6559D20-001
[junit4] 2> NOTE: test params are: codec=Lucene46: {}, docValues:{}, sim=DefaultSimilarity, locale=es_BO, timezone=Europe/Jersey
[junit4] 2> NOTE: Linux 3.8.0-39-generic amd64/Oracle Corporation 1.8.0_20-ea (64-bit)/cpus=8,threads=1,free=67485224,total=346923008
[junit4] 2> NOTE: All tests run in this JVM: [NoCacheHeaderTest, QueryResultKeyTest, SimplePostToolTest, TestDFRSimilarityFactory, TestCollapseQParserPlugin, ConvertedLegacyTest, TestExpandComponent, TimeZoneUtilsTest, TestRangeQuery, FileUtilsTest, SpellCheckComponentTest, TestSchemaNameResource, TestMiniSolrCloudCluster, JSONWriterTest, NotRequiredUniqueKeyTest, BlockDirectoryTest, ZkNodePropsTest, TestSolrCoreProperties, TestAtomicUpdateErrorCases, TestReload, TestBinaryField, CoreContainerCoreInitFailuresTest, SolrCmdDistributorTest, ParsingFieldUpdateProcessorsTest, InfoHandlerTest, TestFastWriter, CachingDirectoryFactoryTest, DirectUpdateHandlerTest, TestJmxIntegration, TestIndexingPerformance, TestInfoStreamLogging, OutputWriterTest, TestHighlightDedupGrouping, TestDefaultSimilarityFactory, TestAddFieldRealTimeGet, BlockCacheTest, TestFiltering, DefaultValueUpdateProcessorTest, PingRequestHandlerTest, SolrRequestParserTest, TestQueryTypes, TestComponentsName, TestXIncludeConfig, TestSchemaSimilarityResource, DeleteReplicaTest, TestPartialUpdateDeduplication, TestMaxScoreQueryParser, TestUtils, TestStressRecovery, DistributedSuggestComponentTest, PreAnalyzedUpdateProcessorTest, SuggesterTSTTest, DocValuesMultiTest, TestDynamicFieldCollectionResource, TestSweetSpotSimilarityFactory, TestManagedSchemaFieldResource, TestDistribDocBasedVersion, PathHierarchyTokenizerFactoryTest, OverseerRolesTest, SuggesterWFSTTest, TestCSVLoader, DirectSolrConnectionTest, ShardRoutingCustomTest, OpenExchangeRatesOrgProviderTest, TestRandomFaceting, HdfsWriteToMultipleCollectionsTest, ChangedSchemaMergeTest, SolrIndexConfigTest, AlternateDirectoryTest, FullSolrCloudDistribCmdsTest, DistribDocExpirationUpdateProcessorTest, SolrPluginUtilsTest, TestFieldTypeCollectionResource, DistribCursorPagingTest, TestFastOutputStream, StandardRequestHandlerTest, HdfsCollectionsAPIDistributedZkTest, CustomCollectionTest, XsltUpdateRequestHandlerTest, SignatureUpdateProcessorFactoryTest, TestNoOpRegenerator, OpenCloseCoreStressTest, TestInitQParser, TestFastLRUCache, TestLazyCores, FieldAnalysisRequestHandlerTest, TestWordDelimiterFilterFactory, CurrencyFieldOpenExchangeTest, TestFoldingMultitermQuery, ChaosMonkeySafeLeaderTest, PreAnalyzedFieldTest, DistributedExpandComponentTest, TestQuerySenderListener, HdfsLockFactoryTest, TestStressReorder, BasicDistributedZk2Test, OverseerTest, LeaderElectionIntegrationTest, RecoveryZkTest, ZkSolrClientTest, ZkCLITest, TestDistributedSearch, TestFaceting, TestRecovery, TestHashPartitioner, TestMultiCoreConfBootstrap, HardAutoCommitTest, DistributedTermsComponentTest, TestSolr4Spatial, SolrCoreTest, StatsComponentTest, PeerSyncTest, BadIndexSchemaTest, BasicFunctionalityTest, TestBadConfig, TestIndexSearcher, ShowFileRequestHandlerTest, TestCoreDiscovery, DocValuesTest, TestStressLucene, PolyFieldTest, TestUpdate, DirectUpdateHandlerOptimizeTest, StatelessScriptUpdateProcessorFactoryTest, TestSolrDeletionPolicy1, DebugComponentTest, TestSurroundQueryParser, DisMaxRequestHandlerTest, DirectSolrSpellCheckerTest, TestOmitPositions, RequestHandlersTest, TermVectorComponentTest, TestSolrQueryParser, FastVectorHighlighterTest, IndexSchemaTest, TestCSVResponseWriter, TestAnalyzedSuggestions, BinaryUpdateRequestHandlerTest, CSVRequestHandlerTest, TestBinaryResponseWriter, HighlighterConfigTest, UpdateParamsTest, CopyFieldTest, TestSearchPerf, TestConfig, ExternalFileFieldSortTest, TestPostingsSolrHighlighter, TestPhraseSuggestions, SpellPossibilityIteratorTest, SynonymTokenizerTest, TestIBSimilarityFactory, ScriptEngineTest, DateMathParserTest, TestSolrXMLSerializer, TestSystemIdResolver, PrimUtilsTest, TestSuggestSpellingConverter, DateFieldTest, SpellingQueryConverterTest, DOMUtilTest, RAMDirectoryFactoryTest, TestSolrJ, TestDocumentBuilder, SliceStateTest, CircularListTest, TestRTGBase, CursorPagingTest, SolrTestCaseJ4Test, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, TestCollationKeyRangeQueries, AliasIntegrationTest]
[junit4] Completed on J1 in 36.53s, 1 test, 1 error <<< FAILURES!
[...truncated 205 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/lucene/common-build.xml:1293: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/lucene/common-build.xml:919: There were test failures: 387 suites, 1624 tests, 2 errors, 37 ignored (16 assumptions)
Total time: 55 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0_20-ea-b11 -XX:-UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.8-Linux (64bit/jdk1.8.0_05) - Build # 129 -
Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.8-Linux/129/
Java: 64bit/jdk1.8.0_05 -XX:+UseCompressedOops -XX:+UseParallelGC
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.DistribCursorPagingTest
Error Message:
ERROR: SolrZkClient opens=12 closes=11
Stack Trace:
java.lang.AssertionError: ERROR: SolrZkClient opens=12 closes=11
at __randomizedtesting.SeedInfo.seed([CA2A8A102C0F8CB3]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:434)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:180)
at sun.reflect.GeneratedMethodAccessor28.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:790)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.DistribCursorPagingTest
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.DistribCursorPagingTest: 1) Thread[id=3037, name=TEST-DistribCursorPagingTest.testDistribSearch-seed#[CA2A8A102C0F8CB3]-SendThread(127.0.0.1:46594), state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994) 2) Thread[id=3038, name=TEST-DistribCursorPagingTest.testDistribSearch-seed#[CA2A8A102C0F8CB3]-EventThread, state=WAITING, group=TGRP-DistribCursorPagingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.DistribCursorPagingTest:
1) Thread[id=3037, name=TEST-DistribCursorPagingTest.testDistribSearch-seed#[CA2A8A102C0F8CB3]-SendThread(127.0.0.1:46594), state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
2) Thread[id=3038, name=TEST-DistribCursorPagingTest.testDistribSearch-seed#[CA2A8A102C0F8CB3]-EventThread, state=WAITING, group=TGRP-DistribCursorPagingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
at __randomizedtesting.SeedInfo.seed([CA2A8A102C0F8CB3]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.DistribCursorPagingTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=3037, name=TEST-DistribCursorPagingTest.testDistribSearch-seed#[CA2A8A102C0F8CB3]-SendThread(127.0.0.1:46594), state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=3037, name=TEST-DistribCursorPagingTest.testDistribSearch-seed#[CA2A8A102C0F8CB3]-SendThread(127.0.0.1:46594), state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
at __randomizedtesting.SeedInfo.seed([CA2A8A102C0F8CB3]:0)
Build Log:
[...truncated 11079 lines...]
[junit4] Suite: org.apache.solr.cloud.DistribCursorPagingTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/init-core-data-001
[junit4] 2> 676266 T2958 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
[junit4] 2> 676266 T2958 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /q_u/yf
[junit4] 2> 676269 T2958 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 676269 T2958 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 676269 T2959 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 676369 T2958 oasc.ZkTestServer.run start zk server on port:46594
[junit4] 2> 676370 T2958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 676600 T2965 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@77dc7e82 name:ZooKeeperConnection Watcher:127.0.0.1:46594 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 676600 T2958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 676601 T2958 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 676604 T2958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 676605 T2967 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@480931b4 name:ZooKeeperConnection Watcher:127.0.0.1:46594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 676606 T2958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 676606 T2958 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 676607 T2958 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 676609 T2958 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 676610 T2958 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 676611 T2958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-deeppaging.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 676611 T2958 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 676613 T2958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/schema-sorts.xml to /configs/conf1/schema.xml
[junit4] 2> 676614 T2958 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 676615 T2958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 676616 T2958 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 676620 T2958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 676621 T2958 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 676623 T2958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 676623 T2958 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 676625 T2958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 676626 T2958 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 676627 T2958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 676628 T2958 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 676631 T2958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 676631 T2958 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 676633 T2958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 676634 T2958 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 676636 T2958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 676636 T2958 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 676638 T2958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 676639 T2958 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 676641 T2960 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145db56f2860001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 676916 T2958 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 676921 T2958 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35958
[junit4] 2> 676922 T2958 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 676922 T2958 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 676922 T2958 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-002
[junit4] 2> 676922 T2958 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-002/'
[junit4] 2> 676933 T2958 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-002/solr.xml
[junit4] 2> 676940 T2958 oasc.CoreContainer.<init> New CoreContainer 1370555605
[junit4] 2> 676940 T2958 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-002/]
[junit4] 2> 676940 T2958 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 676941 T2958 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 676941 T2958 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 676941 T2958 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 676941 T2958 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 676941 T2958 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 676942 T2958 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 676942 T2958 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 676942 T2958 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 676942 T2958 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 676943 T2958 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 676943 T2958 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 676943 T2958 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46594/solr
[junit4] 2> 676943 T2958 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 676944 T2958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 676946 T2978 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33b4e04a name:ZooKeeperConnection Watcher:127.0.0.1:46594 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 676946 T2958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 676948 T2958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 676949 T2980 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@46c0a83b name:ZooKeeperConnection Watcher:127.0.0.1:46594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 676949 T2958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 676950 T2958 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 676952 T2958 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 676954 T2958 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 676958 T2958 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 676964 T2958 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 676968 T2958 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 676970 T2958 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35958_q_u%2Fyf
[junit4] 2> 676971 T2958 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35958_q_u%2Fyf
[junit4] 2> 676972 T2958 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 676976 T2958 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 676979 T2958 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:35958_q_u%2Fyf
[junit4] 2> 676980 T2958 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 676981 T2958 oasc.Overseer.start Overseer (id=91720533913501699-127.0.0.1:35958_q_u%2Fyf-n_0000000000) starting
[junit4] 2> 676983 T2958 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 676988 T2958 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 676988 T2982 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 676989 T2982 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:35958_q_u%2Fyf
[junit4] 2> 676991 T2958 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 676992 T2958 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 676996 T2981 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 676998 T2983 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 676998 T2983 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 676999 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 677000 T2983 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 677001 T2981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 677001 T2981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:35958/q_u/yf",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:35958_q_u%2Fyf",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 677002 T2981 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 677002 T2981 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 677003 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 677004 T2980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 678000 T2983 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 678000 T2983 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 678001 T2983 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 678001 T2983 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 678002 T2983 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 678002 T2983 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-002/collection1/'
[junit4] 2> 678003 T2983 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 678004 T2983 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 678005 T2983 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 678030 T2983 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 678057 T2983 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 678058 T2983 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 678062 T2983 oass.IndexSchema.readSchema [collection1] Schema name=sortable
[junit4] 2> 678472 T2983 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 678473 T2983 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 678474 T2983 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 678474 T2983 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-002/collection1/, dataDir=./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-001/control/data/
[junit4] 2> 678474 T2983 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 678475 T2983 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-001/control/data
[junit4] 2> 678475 T2983 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-001/control/data/index/
[junit4] 2> 678475 T2983 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 678475 T2983 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-001/control/data/index
[junit4] 2> 678476 T2983 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=27.4814453125, floorSegmentMB=1.48046875, forceMergeDeletesPctAllowed=18.9856854619832, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 678476 T2983 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7a95bcf9 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@61e14dc9),segFN=segments_1,generation=1}
[junit4] 2> 678477 T2983 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 678477 T2983 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 678477 T2983 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 678477 T2983 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 678477 T2983 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 678478 T2983 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4] 2> 678478 T2983 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 678482 T2983 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4] 2> 678483 T2983 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 678484 T2983 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 678485 T2983 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 678485 T2983 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=74.5869140625, floorSegmentMB=0.8916015625, forceMergeDeletesPctAllowed=15.107320202651106, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 678485 T2983 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7a95bcf9 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@61e14dc9),segFN=segments_1,generation=1}
[junit4] 2> 678485 T2983 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 678485 T2983 oass.SolrIndexSearcher.<init> Opening Searcher@18029da4[collection1] main
[junit4] 2> 678486 T2983 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 678486 T2983 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 678487 T2983 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 678487 T2983 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 678487 T2983 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 678487 T2983 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 678488 T2983 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 678488 T2983 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 678488 T2983 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 678489 T2983 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 678489 T2983 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 678489 T2984 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@18029da4[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 678490 T2987 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:35958/q_u/yf collection:control_collection shard:shard1
[junit4] 2> 678490 T2958 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1
[junit4] 2> 678490 T2958 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 678491 T2958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 678492 T2987 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 678494 T2989 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@751d0f44 name:ZooKeeperConnection Watcher:127.0.0.1:46594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 678494 T2958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 678495 T2958 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 678497 T2958 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 678501 T2987 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 678502 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 678502 T2987 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 678503 T2987 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C574 name=collection1 org.apache.solr.core.SolrCore@6a735b5c url=http://127.0.0.1:35958/q_u/yf/collection1 node=127.0.0.1:35958_q_u%2Fyf C574_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:35958/q_u/yf, core=collection1, node_name=127.0.0.1:35958_q_u%2Fyf}
[junit4] 2> 678503 T2987 C574 P35958 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:35958/q_u/yf/collection1/
[junit4] 2> 678503 T2987 C574 P35958 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 678503 T2981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 678503 T2987 C574 P35958 oasc.SyncStrategy.syncToMe http://127.0.0.1:35958/q_u/yf/collection1/ has no replicas
[junit4] 2> 678504 T2987 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:35958/q_u/yf/collection1/ shard1
[junit4] 2> 678504 T2987 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 678505 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 678506 T2980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 678506 T2989 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 678509 T2981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 678556 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 678658 T2989 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 678658 T2980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 678709 T2987 oasc.ZkController.register We are http://127.0.0.1:35958/q_u/yf/collection1/ and leader is http://127.0.0.1:35958/q_u/yf/collection1/
[junit4] 2> 678709 T2987 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35958/q_u/yf
[junit4] 2> 678709 T2987 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 678709 T2987 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 678709 T2987 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 678710 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 678710 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 678710 T2987 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 678710 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 678711 T2981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 678712 T2981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:35958/q_u/yf",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:35958_q_u%2Fyf",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 678713 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 678751 T2958 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 678751 T2958 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 678753 T2958 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60531
[junit4] 2> 678753 T2958 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 678754 T2958 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 678754 T2958 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-003
[junit4] 2> 678754 T2958 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-003/'
[junit4] 2> 678766 T2958 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-003/solr.xml
[junit4] 2> 678773 T2958 oasc.CoreContainer.<init> New CoreContainer 699432553
[junit4] 2> 678773 T2958 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-003/]
[junit4] 2> 678773 T2958 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 678774 T2958 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 678774 T2958 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 678774 T2958 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 678774 T2958 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 678774 T2958 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 678775 T2958 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 678775 T2958 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 678775 T2958 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 678775 T2958 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 678776 T2958 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 678776 T2958 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 678776 T2958 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46594/solr
[junit4] 2> 678776 T2958 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 678777 T2958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 678779 T3000 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@65c61e52 name:ZooKeeperConnection Watcher:127.0.0.1:46594 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 678779 T2958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 678781 T2958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 678782 T3002 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@392eef5d name:ZooKeeperConnection Watcher:127.0.0.1:46594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 678782 T2958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 678787 T2958 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 678815 T2989 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 678815 T3002 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 678815 T2980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 679789 T2958 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60531_q_u%2Fyf
[junit4] 2> 679791 T2958 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60531_q_u%2Fyf
[junit4] 2> 679794 T2980 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 679794 T3002 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 679794 T2989 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 679800 T3003 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 679800 T3003 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 679802 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 679803 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 679803 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 679802 T3003 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 679805 T2981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 679806 T2981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:60531/q_u/yf",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:60531_q_u%2Fyf",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 679806 T2981 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 679806 T2981 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 679809 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 679913 T2989 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 679913 T2980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 679913 T3002 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 680804 T3003 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 680804 T3003 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 680805 T3003 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 680805 T3003 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 680807 T3003 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 680807 T3003 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-003/collection1/'
[junit4] 2> 680808 T3003 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 680808 T3003 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 680809 T3003 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 680834 T3003 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 680839 T3003 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 680840 T3003 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 680843 T3003 oass.IndexSchema.readSchema [collection1] Schema name=sortable
[junit4] 2> 680982 T3003 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 680983 T3003 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 680983 T3003 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 680983 T3003 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-003/collection1/, dataDir=./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-001/jetty1/
[junit4] 2> 680984 T3003 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 680984 T3003 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-001/jetty1
[junit4] 2> 680984 T3003 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-001/jetty1/index/
[junit4] 2> 680984 T3003 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 680985 T3003 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-001/jetty1/index
[junit4] 2> 680985 T3003 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=27.4814453125, floorSegmentMB=1.48046875, forceMergeDeletesPctAllowed=18.9856854619832, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 680985 T3003 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7568cfbf lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@c62070f),segFN=segments_1,generation=1}
[junit4] 2> 680986 T3003 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 680986 T3003 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 680986 T3003 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 680986 T3003 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 680987 T3003 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 680987 T3003 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4] 2> 680987 T3003 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 680987 T3003 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4] 2> 680988 T3003 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 680995 T3003 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 680995 T3003 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 680996 T3003 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=74.5869140625, floorSegmentMB=0.8916015625, forceMergeDeletesPctAllowed=15.107320202651106, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 680996 T3003 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7568cfbf lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@c62070f),segFN=segments_1,generation=1}
[junit4] 2> 680996 T3003 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 680997 T3003 oass.SolrIndexSearcher.<init> Opening Searcher@27905e02[collection1] main
[junit4] 2> 680997 T3003 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 680998 T3003 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 680998 T3003 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 680998 T3003 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 680999 T3003 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 680999 T3003 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 680999 T3003 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 680999 T3003 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 681000 T3003 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 681000 T3003 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 681000 T3003 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 681000 T3004 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@27905e02[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 681001 T3007 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60531/q_u/yf collection:collection1 shard:shard2
[junit4] 2> 681001 T2958 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1
[junit4] 2> 681002 T2958 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 681002 T3007 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 681006 T3007 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 681007 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 681007 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 681008 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 681008 T3007 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 681008 T3007 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 681008 T2981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C575 name=collection1 org.apache.solr.core.SolrCore@4a238159 url=http://127.0.0.1:60531/q_u/yf/collection1 node=127.0.0.1:60531_q_u%2Fyf C575_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:60531/q_u/yf, core=collection1, node_name=127.0.0.1:60531_q_u%2Fyf}
[junit4] 2> 681008 T3007 C575 P60531 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60531/q_u/yf/collection1/
[junit4] 2> 681009 T3007 C575 P60531 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 681009 T3007 C575 P60531 oasc.SyncStrategy.syncToMe http://127.0.0.1:60531/q_u/yf/collection1/ has no replicas
[junit4] 2> 681009 T3007 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60531/q_u/yf/collection1/ shard2
[junit4] 2> 681009 T3007 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 681010 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 681012 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 681013 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 681118 T2989 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 681118 T3002 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 681118 T2980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 681162 T3007 oasc.ZkController.register We are http://127.0.0.1:60531/q_u/yf/collection1/ and leader is http://127.0.0.1:60531/q_u/yf/collection1/
[junit4] 2> 681163 T3007 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60531/q_u/yf
[junit4] 2> 681163 T3007 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 681163 T3007 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 681163 T3007 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 681164 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 681164 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 681164 T3007 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 681164 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 681165 T2981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 681165 T2981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:60531/q_u/yf",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:60531_q_u%2Fyf",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 681167 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 681225 T2958 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 681226 T2958 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 681227 T2958 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59619
[junit4] 2> 681229 T2958 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 681230 T2958 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 681230 T2958 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-004
[junit4] 2> 681230 T2958 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-004/'
[junit4] 2> 681240 T2958 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-004/solr.xml
[junit4] 2> 681246 T2958 oasc.CoreContainer.<init> New CoreContainer 1250248907
[junit4] 2> 681246 T2958 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-004/]
[junit4] 2> 681247 T2958 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 681247 T2958 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 681247 T2958 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 681247 T2958 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 681247 T2958 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 681248 T2958 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 681248 T2958 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 681248 T2958 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 681248 T2958 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 681249 T2958 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 681249 T2958 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 681249 T2958 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 681249 T2958 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46594/solr
[junit4] 2> 681250 T2958 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 681250 T2958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 681252 T3018 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@45a4be2c name:ZooKeeperConnection Watcher:127.0.0.1:46594 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 681252 T2958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 681255 T2958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 681256 T3020 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@698e1d72 name:ZooKeeperConnection Watcher:127.0.0.1:46594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 681256 T2958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 681260 T2958 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 681268 T2980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 681268 T3020 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 681268 T3002 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 681268 T2989 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 682262 T2958 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59619_q_u%2Fyf
[junit4] 2> 682263 T2958 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59619_q_u%2Fyf
[junit4] 2> 682265 T3002 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 682265 T2980 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 682265 T3020 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 682265 T2989 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 682269 T3021 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 682269 T3021 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 682270 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 682270 T3021 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 682270 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 682271 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 682271 T2981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 682271 T2981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:59619/q_u/yf",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:59619_q_u%2Fyf",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 682272 T2981 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 682272 T2981 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 682273 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 683811 T2962 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 1435ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 683812 T2980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 683812 T3020 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 683812 T3002 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 683812 T2989 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 684271 T3021 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 684271 T3021 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 684272 T3021 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 684272 T3021 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 684273 T3021 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 684274 T3021 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-004/collection1/'
[junit4] 2> 684274 T3021 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 684275 T3021 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 684275 T3021 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 684297 T3021 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 684303 T3021 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 684303 T3021 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 684306 T3021 oass.IndexSchema.readSchema [collection1] Schema name=sortable
[junit4] 2> 684453 T3021 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 684454 T3021 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 684454 T3021 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 684454 T3021 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-004/collection1/, dataDir=./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-001/jetty2/
[junit4] 2> 684454 T3021 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 684454 T3021 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-001/jetty2
[junit4] 2> 684455 T3021 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-001/jetty2/index/
[junit4] 2> 684455 T3021 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 684455 T3021 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-001/jetty2/index
[junit4] 2> 684455 T3021 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=27.4814453125, floorSegmentMB=1.48046875, forceMergeDeletesPctAllowed=18.9856854619832, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 684456 T3021 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@16b9d618 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@30bed86b),segFN=segments_1,generation=1}
[junit4] 2> 684456 T3021 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 684457 T3021 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 684457 T3021 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 684457 T3021 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 684457 T3021 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 684457 T3021 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4] 2> 684457 T3021 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 684457 T3021 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4] 2> 684459 T3021 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 684460 T3021 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 684460 T3021 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 684460 T3021 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=74.5869140625, floorSegmentMB=0.8916015625, forceMergeDeletesPctAllowed=15.107320202651106, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 684460 T3021 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@16b9d618 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@30bed86b),segFN=segments_1,generation=1}
[junit4] 2> 684461 T3021 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 684461 T3021 oass.SolrIndexSearcher.<init> Opening Searcher@7058c376[collection1] main
[junit4] 2> 684461 T3021 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 684462 T3021 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 684462 T3021 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 684462 T3021 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 684462 T3021 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 684462 T3021 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 684463 T3021 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 684463 T3021 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 684463 T3021 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 684463 T3021 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 684464 T3022 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7058c376[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 684464 T3021 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 684464 T3025 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59619/q_u/yf collection:collection1 shard:shard1
[junit4] 2> 684464 T2958 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1
[junit4] 2> 684465 T2958 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 684465 T3025 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 684542 T3025 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 684582 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 684582 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 684582 T3025 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 684582 T3025 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 684582 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> ASYNC NEW_CORE C576 name=collection1 org.apache.solr.core.SolrCore@556c9a3f url=http://127.0.0.1:59619/q_u/yf/collection1 node=127.0.0.1:59619_q_u%2Fyf C576_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:59619/q_u/yf, core=collection1, node_name=127.0.0.1:59619_q_u%2Fyf}
[junit4] 2> 684582 T3025 C576 P59619 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59619/q_u/yf/collection1/
[junit4] 2> 684583 T3025 C576 P59619 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 684583 T3025 C576 P59619 oasc.SyncStrategy.syncToMe http://127.0.0.1:59619/q_u/yf/collection1/ has no replicas
[junit4] 2> 684583 T3025 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59619/q_u/yf/collection1/ shard1
[junit4] 2> 684583 T3025 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 684584 T2981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 684642 T2980 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 684682 T2989 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 684682 T2980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 684682 T3002 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 684682 T3020 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 684685 T2958 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 684686 T2958 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 684688 T2958 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50214
[junit4] 2> 684689 T2958 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 684689 T2958 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 684689 T2958 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-005
[junit4] 2> 684689 T2958 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-005/'
[junit4] 2> 684699 T2958 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-005/solr.xml
[junit4] 2> 684704 T2958 oasc.CoreContainer.<init> New CoreContainer 1008089750
[junit4] 2> 684705 T2958 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.DistribCursorPagingTest-CA2A8A102C0F8CB3-001/tempDir-005/]
[junit4] 2> 684705 T2958 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 684705 T2958 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 684706 T2958 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 684706 T2958 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 684706 T2958 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 684706 T2958 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 684706 T2958 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 684706 T2958 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 684707 T2958 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 684707 T2958 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 684707 T2958 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 684707 T2958 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 684708 T2958 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46594/solr
[junit4] 2> 684708 T2958 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 684709 T2958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 691352 T2960 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145db56f2860004, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 691452 T2989 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@751d0f44 name:ZooKeeperConnection Watcher:127.0.0.1:46594/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 691452 T2989 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 692613 T2989 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@751d0f44 name:ZooKeeperConnection Watcher:127.0.0.1:46594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 698021 T2960 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145db56f2860008, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 698021 T2960 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145db56f2860003, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 698022 T2960 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145db56f2860006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 699283 T2960 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145db56f2860004, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 699383 T2989 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@751d0f44 name:ZooKeeperConnection Watcher:127.0.0.1:46594/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 699383 T2989 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 700953 T2989 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@751d0f44 name:ZooKeeperConnection Watcher:127.0.0.1:46594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 706658 T2962 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 21975ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 706659 T2962 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 706659 T2962 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 706661 T2962 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 706662 T2962 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 706663 T2962 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 706663 T3036 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76a4ea60 name:ZooKeeperConnection Watcher:127.0.0.1:46594 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 706663 T2962 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 706664 T2958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 706664 T2962 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 706666 T2962 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 706666 T2962 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java
[...truncated too long message...]
ngsFormat(name=Asserting), currency____currency=Pulsing41(freqCutoff=1 minBlockSize=94 maxBlockSize=252), date_first=Lucene41(blocksize=128), legacy_sortable_double=Pulsing41(freqCutoff=1 minBlockSize=94 maxBlockSize=252), legacy_date_last=Lucene41(blocksize=128), bool=Pulsing41(freqCutoff=1 minBlockSize=94 maxBlockSize=252), currency_first____amount_raw=PostingsFormat(name=Memory doPackFST= false), currency_first____currency=PostingsFormat(name=Memory doPackFST= false), double_last=PostingsFormat(name=Asserting), int_last=Pulsing41(freqCutoff=1 minBlockSize=94 maxBlockSize=252), long=PostingsFormat(name=Asserting), enum_first=Pulsing41(freqCutoff=1 minBlockSize=94 maxBlockSize=252), bcd_int_last=Pulsing41(freqCutoff=1 minBlockSize=94 maxBlockSize=252), double_first=Pulsing41(freqCutoff=1 minBlockSize=94 maxBlockSize=252), legacy_sortable_double_first=PostingsFormat(name=Memory doPackFST= false), icu_collation_en_primary_first=PostingsFormat(name=Memory doPackFST= false), float_first=Lucene41(blocksize=128), legacy_sortable_int=Pulsing41(freqCutoff=1 minBlockSize=94 maxBlockSize=252), currency____amount_raw=Pulsing41(freqCutoff=1 minBlockSize=94 maxBlockSize=252), long_first=Lucene41(blocksize=128), currency_last____currency=Lucene41(blocksize=128), bcd_long_first=Lucene41(blocksize=128), bool_first=PostingsFormat(name=Memory doPackFST= false), legacy_sortable_long_last=PostingsFormat(name=Asserting), long_last=PostingsFormat(name=Memory doPackFST= false), bcd_int_first=PostingsFormat(name=Asserting), legacy_sortable_long=PostingsFormat(name=Memory doPackFST= false), bcd_long_last=PostingsFormat(name=Memory doPackFST= false), int=Lucene41(blocksize=128), legacy_int=PostingsFormat(name=Memory doPackFST= false), int_first=PostingsFormat(name=Asserting), legacy_long=Pulsing41(freqCutoff=1 minBlockSize=94 maxBlockSize=252), enum_last=PostingsFormat(name=Asserting), _version_=Pulsing41(freqCutoff=1 minBlockSize=94 maxBlockSize=252), bcd_str=Lucene41(blocksize=128), currency_last____amount_raw=PostingsFormat(name=Memory doPackFST= false), float_last=Lucene41(blocksize=128), legacy_date_first=PostingsFormat(name=Memory doPackFST= false), legacy_sortable_int_last=Lucene41(blocksize=128)}, docValues:{uuid_dv=DocValuesFormat(name=SimpleText), collation_en_primary_dv_first=DocValuesFormat(name=Lucene45), icu_collation_en_primary_dv_first=DocValuesFormat(name=Lucene45), date_dv=DocValuesFormat(name=Disk), collation_en_primary_dv=DocValuesFormat(name=Asserting), float_dv_first=DocValuesFormat(name=SimpleText), double_dv_last=DocValuesFormat(name=Disk), uuid_dv_last=DocValuesFormat(name=Asserting), date_dv_last=DocValuesFormat(name=SimpleText), date_dv_first=DocValuesFormat(name=Lucene45), str_dv_last=DocValuesFormat(name=Disk), icu_collation_en_primary_dv_last=DocValuesFormat(name=SimpleText), int_dv=DocValuesFormat(name=SimpleText), str_dv_first=DocValuesFormat(name=Asserting), icu_collation_en_primary_dv=DocValuesFormat(name=Asserting), float_dv=DocValuesFormat(name=Asserting), long_dv_last=DocValuesFormat(name=Lucene45), int_dv_first=DocValuesFormat(name=Disk), collation_en_primary_dv_last=DocValuesFormat(name=SimpleText), long_dv_first=DocValuesFormat(name=SimpleText), double_dv_first=DocValuesFormat(name=Disk), float_dv_last=DocValuesFormat(name=Lucene45), bin_dv_last=DocValuesFormat(name=Asserting), uuid_dv_first=DocValuesFormat(name=Asserting), double_dv=DocValuesFormat(name=Lucene45), str_dv=DocValuesFormat(name=Lucene45), int_dv_last=DocValuesFormat(name=Disk), bin_dv_first=DocValuesFormat(name=Asserting), long_dv=DocValuesFormat(name=Asserting), bin_dv=DocValuesFormat(name=SimpleText)}, sim=DefaultSimilarity, locale=ar_SA, timezone=Canada/Atlantic
[junit4] 2> NOTE: Linux 3.8.0-39-generic amd64/Oracle Corporation 1.8.0_05 (64-bit)/cpus=8,threads=2,free=103180440,total=278921216
[junit4] 2> NOTE: All tests run in this JVM: [TestFoldingMultitermQuery, TestManagedSynonymFilterFactory, TestStandardQParsers, TestStressReorder, XsltUpdateRequestHandlerTest, TestRangeQuery, HdfsWriteToMultipleCollectionsTest, DistributedSuggestComponentTest, SpellingQueryConverterTest, RAMDirectoryFactoryTest, TestSchemaSimilarityResource, TestCodecSupport, TestFastOutputStream, TestInfoStreamLogging, DeleteInactiveReplicaTest, TestRecovery, NotRequiredUniqueKeyTest, BasicDistributedZk2Test, FieldAnalysisRequestHandlerTest, TestUtils, TestRandomFaceting, TestLazyCores, TestIBSimilarityFactory, MinimalSchemaTest, PrimUtilsTest, SSLMigrationTest, TestComponentsName, TestIndexSearcher, TestCSVLoader, QueryResultKeyTest, TestStressRecovery, TestHighFrequencyDictionaryFactory, BadIndexSchemaTest, TestAnalyzedSuggestions, TestSchemaResource, TestJmxIntegration, SpellCheckCollatorTest, IndexBasedSpellCheckerTest, TestDefaultSimilarityFactory, TimeZoneUtilsTest, DirectSolrSpellCheckerTest, TestBinaryField, AlternateDirectoryTest, CurrencyFieldXmlFileTest, TestQuerySenderListener, TestQuerySenderNoQuery, MigrateRouteKeyTest, TestNumberUtils, FileUtilsTest, HighlighterConfigTest, TestDistribDocBasedVersion, ParsingFieldUpdateProcessorsTest, TestDynamicFieldCollectionResource, CachingDirectoryFactoryTest, TestHashPartitioner, TestExpandComponent, TestFileDictionaryLookup, TestCloudManagedSchema, TestSolrCoreProperties, DistributedExpandComponentTest, ChaosMonkeySafeLeaderTest, AliasIntegrationTest, TestInitQParser, BlockDirectoryTest, TestSolrQueryParserDefaultOperatorResource, ChaosMonkeyNothingIsSafeTest, FullSolrCloudDistribCmdsTest, HighlighterTest, HdfsDirectoryTest, RequestHandlersTest, LeaderElectionIntegrationTest, CoreContainerCoreInitFailuresTest, TestSolrXml, DocValuesMultiTest, MultiTermTest, DistanceFunctionTest, ZkSolrClientTest, TestDistributedGrouping, DistribCursorPagingTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=DistribCursorPagingTest -Dtests.seed=CA2A8A102C0F8CB3 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_SA -Dtests.timezone=Canada/Atlantic -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J1 | DistribCursorPagingTest (suite) <<<
[junit4] > Throwable #1: java.lang.AssertionError: ERROR: SolrZkClient opens=12 closes=11
[junit4] > at __randomizedtesting.SeedInfo.seed([CA2A8A102C0F8CB3]:0)
[junit4] > at org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:434)
[junit4] > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:180)
[junit4] > at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.DistribCursorPagingTest:
[junit4] > 1) Thread[id=3037, name=TEST-DistribCursorPagingTest.testDistribSearch-seed#[CA2A8A102C0F8CB3]-SendThread(127.0.0.1:46594), state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
[junit4] > 2) Thread[id=3038, name=TEST-DistribCursorPagingTest.testDistribSearch-seed#[CA2A8A102C0F8CB3]-EventThread, state=WAITING, group=TGRP-DistribCursorPagingTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
[junit4] > at __randomizedtesting.SeedInfo.seed([CA2A8A102C0F8CB3]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=3037, name=TEST-DistribCursorPagingTest.testDistribSearch-seed#[CA2A8A102C0F8CB3]-SendThread(127.0.0.1:46594), state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
[junit4] > at __randomizedtesting.SeedInfo.seed([CA2A8A102C0F8CB3]:0)
[junit4] Completed on J1 in 102.39s, 1 test, 1 failure, 2 errors <<< FAILURES!
[...truncated 699 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/lucene/common-build.xml:1293: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/lucene/common-build.xml:919: There were test failures: 387 suites, 1624 tests, 3 suite-level errors, 813 ignored (9 assumptions)
Total time: 48 minutes 3 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0_05 -XX:+UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.8-Linux (32bit/jdk1.8.0_20-ea-b11) - Build
# 128 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.8-Linux/128/
Java: 32bit/jdk1.8.0_20-ea-b11 -client -XX:+UseConcMarkSweepGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.CustomCollectionTest.testDistribSearch
Error Message:
collection already exists: implicitcoll1
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: collection already exists: implicitcoll1
at __randomizedtesting.SeedInfo.seed([4F30854DB3E6369F:CED60B55C4B956A3]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:554)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:340)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:301)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:636)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1661)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1615)
at org.apache.solr.cloud.CustomCollectionTest.testCustomCollectionsAPI(CustomCollectionTest.java:184)
at org.apache.solr.cloud.CustomCollectionTest.doTest(CustomCollectionTest.java:127)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11645 lines...]
[junit4] Suite: org.apache.solr.cloud.CustomCollectionTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/init-core-data-001
[junit4] 2> 1348599 T4400 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 1348599 T4400 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /z_b/q
[junit4] 2> 1348604 T4400 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 1348605 T4400 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1348605 T4401 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1348705 T4400 oasc.ZkTestServer.run start zk server on port:41470
[junit4] 2> 1348706 T4400 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1348763 T4407 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f2c7d9 name:ZooKeeperConnection Watcher:127.0.0.1:41470 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1348763 T4400 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1348764 T4400 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1348769 T4400 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1348770 T4409 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15c5d28 name:ZooKeeperConnection Watcher:127.0.0.1:41470/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1348770 T4400 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1348771 T4400 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1348774 T4400 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1348776 T4400 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1348778 T4400 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1348780 T4400 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1348781 T4400 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1348784 T4400 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1348785 T4400 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1348788 T4400 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1348788 T4400 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1348791 T4400 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1348792 T4400 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1348795 T4400 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1348795 T4400 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1348797 T4400 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1348798 T4400 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1348800 T4400 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1348801 T4400 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1348804 T4400 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1348804 T4400 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1348807 T4400 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1348807 T4400 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1348809 T4400 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1348810 T4400 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1348812 T4400 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1348812 T4400 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1348815 T4400 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1348816 T4411 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b3722f name:ZooKeeperConnection Watcher:127.0.0.1:41470/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1348817 T4400 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1349120 T4400 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1349129 T4400 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1349135 T4400 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:45586
[junit4] 2> 1349137 T4400 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1349138 T4400 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1349138 T4400 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-002
[junit4] 2> 1349139 T4400 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-002/'
[junit4] 2> 1349160 T4400 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-002/solr.xml
[junit4] 2> 1349173 T4400 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-002
[junit4] 2> 1349174 T4400 oasc.CoreContainer.<init> New CoreContainer 6676494
[junit4] 2> 1349174 T4400 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-002/]
[junit4] 2> 1349175 T4400 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1349175 T4400 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1349176 T4400 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1349176 T4400 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1349176 T4400 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1349177 T4400 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1349177 T4400 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1349178 T4400 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1349178 T4400 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1349181 T4400 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1349181 T4400 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1349182 T4400 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1349182 T4400 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41470/solr
[junit4] 2> 1349182 T4400 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1349183 T4400 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1349185 T4422 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@116511a name:ZooKeeperConnection Watcher:127.0.0.1:41470 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1349185 T4400 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1349188 T4400 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1349189 T4424 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e78584 name:ZooKeeperConnection Watcher:127.0.0.1:41470/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1349190 T4400 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1349192 T4400 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1349195 T4400 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1349199 T4400 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1349202 T4400 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1349207 T4400 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1349212 T4400 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1349215 T4400 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45586_z_b%2Fq
[junit4] 2> 1349217 T4400 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45586_z_b%2Fq
[junit4] 2> 1349220 T4400 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1349222 T4400 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1349226 T4400 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:45586_z_b%2Fq
[junit4] 2> 1349227 T4400 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1349229 T4400 oasc.Overseer.start Overseer (id=91719834850820100-127.0.0.1:45586_z_b%2Fq-n_0000000000) starting
[junit4] 2> 1349232 T4400 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1349242 T4426 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1349243 T4400 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1349243 T4426 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:45586_z_b%2Fq
[junit4] 2> 1349246 T4400 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1349248 T4400 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1349251 T4425 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1349252 T4400 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-002
[junit4] 2> 1349263 T4400 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-002/conf/
[junit4] 2> 1349389 T4400 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1349391 T4400 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1
[junit4] 2> 1349391 T4400 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1349395 T4400 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1349398 T4429 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1534504 name:ZooKeeperConnection Watcher:127.0.0.1:41470/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1349398 T4400 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1349401 T4400 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1349405 T4400 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1349664 T4400 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 1349665 T4400 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1349673 T4400 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1349676 T4400 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:38126
[junit4] 2> 1349680 T4400 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1349681 T4400 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1349681 T4400 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-003
[junit4] 2> 1349682 T4400 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-003/'
[junit4] 2> 1349706 T4400 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-003/solr.xml
[junit4] 2> 1349727 T4400 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-003
[junit4] 2> 1349728 T4400 oasc.CoreContainer.<init> New CoreContainer 7796606
[junit4] 2> 1349729 T4400 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-003/]
[junit4] 2> 1349730 T4400 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1349731 T4400 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1349731 T4400 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1349731 T4400 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1349732 T4400 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1349732 T4400 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1349732 T4400 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1349733 T4400 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1349733 T4400 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1349736 T4400 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1349736 T4400 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1349737 T4400 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1349737 T4400 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41470/solr
[junit4] 2> 1349738 T4400 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1349739 T4400 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1349742 T4440 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e20491 name:ZooKeeperConnection Watcher:127.0.0.1:41470 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1349743 T4400 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1349746 T4400 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1349747 T4442 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d7c14a name:ZooKeeperConnection Watcher:127.0.0.1:41470/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1349748 T4400 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1349756 T4400 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1350758 T4400 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38126_z_b%2Fq
[junit4] 2> 1350761 T4400 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38126_z_b%2Fq
[junit4] 2> 1350765 T4442 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1350766 T4424 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1350766 T4429 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1350771 T4400 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-003
[junit4] 2> 1350787 T4400 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-003/conf/
[junit4] 2> 1350924 T4400 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1350926 T4400 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1
[junit4] 2> 1350927 T4400 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1351220 T4400 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 1351221 T4400 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1351225 T4400 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1351226 T4400 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:53301
[junit4] 2> 1351229 T4400 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1351229 T4400 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1351230 T4400 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-004
[junit4] 2> 1351230 T4400 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-004/'
[junit4] 2> 1351247 T4400 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-004/solr.xml
[junit4] 2> 1351258 T4400 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-004
[junit4] 2> 1351259 T4400 oasc.CoreContainer.<init> New CoreContainer 13401285
[junit4] 2> 1351259 T4400 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-004/]
[junit4] 2> 1351260 T4400 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1351260 T4400 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1351261 T4400 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1351261 T4400 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1351261 T4400 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1351262 T4400 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1351262 T4400 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1351262 T4400 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1351263 T4400 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1351265 T4400 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1351266 T4400 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1351266 T4400 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1351266 T4400 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41470/solr
[junit4] 2> 1351267 T4400 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1351268 T4400 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1351271 T4454 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15717f7 name:ZooKeeperConnection Watcher:127.0.0.1:41470 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1351272 T4400 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1351275 T4400 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1351277 T4456 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b051b1 name:ZooKeeperConnection Watcher:127.0.0.1:41470/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1351277 T4400 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1351287 T4400 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1352290 T4400 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53301_z_b%2Fq
[junit4] 2> 1352292 T4400 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53301_z_b%2Fq
[junit4] 2> 1352298 T4442 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1352298 T4456 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1352298 T4429 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1352298 T4424 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1352304 T4400 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-004
[junit4] 2> 1352316 T4400 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-004/conf/
[junit4] 2> 1352424 T4400 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1352425 T4400 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1
[junit4] 2> 1352426 T4400 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1352696 T4400 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 1352697 T4400 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1352701 T4400 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1352703 T4400 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:54152
[junit4] 2> 1352705 T4400 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1352705 T4400 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1352706 T4400 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-005
[junit4] 2> 1352706 T4400 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-005/'
[junit4] 2> 1352726 T4400 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-005/solr.xml
[junit4] 2> 1352736 T4400 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-005
[junit4] 2> 1352737 T4400 oasc.CoreContainer.<init> New CoreContainer 26549849
[junit4] 2> 1352737 T4400 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-005/]
[junit4] 2> 1352738 T4400 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1352738 T4400 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1352739 T4400 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1352739 T4400 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1352740 T4400 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1352740 T4400 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1352740 T4400 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1352741 T4400 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1352741 T4400 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1352744 T4400 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1352744 T4400 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1352744 T4400 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1352745 T4400 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41470/solr
[junit4] 2> 1352745 T4400 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1352746 T4400 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1352748 T4468 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11590cb name:ZooKeeperConnection Watcher:127.0.0.1:41470 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1352749 T4400 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1352752 T4400 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1352753 T4470 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14d2749 name:ZooKeeperConnection Watcher:127.0.0.1:41470/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1352753 T4400 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1352758 T4400 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1353761 T4400 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54152_z_b%2Fq
[junit4] 2> 1353762 T4400 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54152_z_b%2Fq
[junit4] 2> 1353765 T4442 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1353765 T4456 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1353765 T4470 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1353765 T4429 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1353765 T4424 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1353783 T4400 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-005
[junit4] 2> 1353796 T4400 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-005/conf/
[junit4] 2> 1353944 T4400 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1353945 T4400 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1
[junit4] 2> 1353946 T4400 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1354218 T4400 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
[junit4] 2> 1354219 T4400 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1354223 T4400 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1354225 T4400 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:41601
[junit4] 2> 1354227 T4400 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1354227 T4400 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1354228 T4400 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-006
[junit4] 2> 1354228 T4400 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-006/'
[junit4] 2> 1354246 T4400 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-006/solr.xml
[junit4] 2> 1354258 T4400 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-006
[junit4] 2> 1354259 T4400 oasc.CoreContainer.<init> New CoreContainer 30604717
[junit4] 2> 1354259 T4400 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-006/]
[junit4] 2> 1354260 T4400 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1354260 T4400 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1354261 T4400 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1354261 T4400 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1354261 T4400 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1354262 T4400 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1354262 T4400 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1354262 T4400 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1354263 T4400 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1354265 T4400 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1354265 T4400 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1354266 T4400 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1354266 T4400 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41470/solr
[junit4] 2> 1354267 T4400 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1354268 T4400 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1354270 T4482 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11e7439 name:ZooKeeperConnection Watcher:127.0.0.1:41470 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1354270 T4400 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1354274 T4400 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1354276 T4484 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23d158 name:ZooKeeperConnection Watcher:127.0.0.1:41470/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1354276 T4400 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1354282 T4400 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1355286 T4400 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41601_z_b%2Fq
[junit4] 2> 1355287 T4400 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41601_z_b%2Fq
[junit4] 2> 1355290 T4442 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1355290 T4456 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1355290 T4424 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1355290 T4484 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1355290 T4470 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1355290 T4429 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1355294 T4400 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-006
[junit4] 2> 1355302 T4400 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-006/conf/
[junit4] 2> 1355436 T4400 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1355437 T4400 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1
[junit4] 2> 1355437 T4400 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1355440 T4400 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1355442 T4487 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@616d8 name:ZooKeeperConnection Watcher:127.0.0.1:41470/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1355442 T4400 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1355444 T4400 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1355447 T4400 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1355449 T4489 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e8d2c0 name:ZooKeeperConnection Watcher:127.0.0.1:41470/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1355449 T4400 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1355450 T4400 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1355568 T4479 oasha.CollectionsHandler.handleCreateAction Creating Collection : replicationFactor=5&shards=a,b,c&maxShardsPerNode=5&router.name=implicit&name=implicitcoll0&action=CREATE&wt=javabin&version=2
[junit4] 2> 1355570 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1355572 T4426 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"implicitcoll0",
[junit4] 2> "replicationFactor":"5",
[junit4] 2> "maxShardsPerNode":"5",
[junit4] 2> "shards":"a,b,c",
[junit4] 2> "router.name":"implicit"}
[junit4] 2> 1355572 T4426 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"implicitcoll0",
[junit4] 2> "replicationFactor":"5",
[junit4] 2> "maxShardsPerNode":"5",
[junit4] 2> "shards":"a,b,c",
[junit4] 2> "router.name":"implicit"}
[junit4] 2> 1355573 T4426 oasc.OverseerCollectionProcessor.createConfNode Only one config set found in zk - using it:conf1
[junit4] 2> 1355573 T4426 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/implicitcoll0
[junit4] 2> 1355574 T4426 oascc.SolrZkClient.makePath makePath: /collections/implicitcoll0
[junit4] 2> 1355576 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1355578 T4425 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1355578 T4425 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: implicitcoll0
[junit4] 2> 1355578 T4425 oasc.Overseer$ClusterStateUpdater.createCollection Create collection implicitcoll0 with shards [a, b, c]
[junit4] 2> 1355580 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1355581 T4487 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1355581 T4489 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1355581 T4470 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1355581 T4429 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1355582 T4424 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1355582 T4484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1355581 T4456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1355581 T4442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1355677 T4426 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection, shardNames [a, b, c] , replicationFactor : 5
[junit4] 2> 1355677 T4426 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_a_replica1 as part of slice a of collection implicitcoll0 on 127.0.0.1:41601_z_b%2Fq
[junit4] 2> 1355679 T4426 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_a_replica2 as part of slice a of collection implicitcoll0 on 127.0.0.1:38126_z_b%2Fq
[junit4] 2> 1355681 T4426 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_a_replica3 as part of slice a of collection implicitcoll0 on 127.0.0.1:45586_z_b%2Fq
[junit4] 2> 1355685 T4426 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_a_replica4 as part of slice a of collection implicitcoll0 on 127.0.0.1:54152_z_b%2Fq
[junit4] 2> 1355687 T4426 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_a_replica5 as part of slice a of collection implicitcoll0 on 127.0.0.1:53301_z_b%2Fq
[junit4] 2> 1355688 T4426 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_b_replica1 as part of slice b of collection implicitcoll0 on 127.0.0.1:41601_z_b%2Fq
[junit4] 2> 1355692 T4426 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_b_replica2 as part of slice b of collection implicitcoll0 on 127.0.0.1:38126_z_b%2Fq
[junit4] 2> 1355699 T4426 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_b_replica3 as part of slice b of collection implicitcoll0 on 127.0.0.1:45586_z_b%2Fq
[junit4] 2> 1355706 T4426 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_b_replica4 as part of slice b of collection implicitcoll0 on 127.0.0.1:54152_z_b%2Fq
[junit4] 2> 1355708 T4426 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_b_replica5 as part of slice b of collection implicitcoll0 on 127.0.0.1:53301_z_b%2Fq
[junit4] 2> 1355714 T4426 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_c_replica1 as part of slice c of collection implicitcoll0 on 127.0.0.1:41601_z_b%2Fq
[junit4] 2> 1355729 T4426 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_c_replica2 as part of slice c of collection implicitcoll0 on 127.0.0.1:38126_z_b%2Fq
[junit4] 2> 1355742 T4426 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_c_replica3 as part of slice c of collection implicitcoll0 on 127.0.0.1:45586_z_b%2Fq
[junit4] 2> 1355798 T4426 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_c_replica4 as part of slice c of collection implicitcoll0 on 127.0.0.1:54152_z_b%2Fq
[junit4] 2> 1355809 T4426 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_c_replica5 as part of slice c of collection implicitcoll0 on 127.0.0.1:53301_z_b%2Fq
[junit4] 2> 1356044 T4437 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=implicitcoll0_b_replica2&action=CREATE&numShards=3&collection=implicitcoll0&shard=b&wt=javabin&version=2
[junit4] 2> 1356048 T4452 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=implicitcoll0_a_replica5&action=CREATE&numShards=3&collection=implicitcoll0&shard=a&wt=javabin&version=2
[junit4] 2> 1356050 T4437 oasc.ZkController.publish publishing core=implicitcoll0_b_replica2 state=down collection=implicitcoll0
[junit4] 2> 1356050 T4452 oasc.ZkController.publish publishing core=implicitcoll0_a_replica5 state=down collection=implicitcoll0
[junit4] 2> 1356051 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356051 T4437 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1356052 T4452 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1356053 T4425 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1356053 T4425 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:38126/z_b/q",
[junit4] 2> "core":"implicitcoll0_b_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38126_z_b%2Fq",
[junit4] 2> "shard":"b",
[junit4] 2> "collection":"implicitcoll0",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1356056 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356057 T4425 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:53301/z_b/q",
[junit4] 2> "core":"implicitcoll0_a_replica5",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53301_z_b%2Fq",
[junit4] 2> "shard":"a",
[junit4] 2> "collection":"implicitcoll0",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1356064 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356064 T4463 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=implicitcoll0_a_replica4&action=CREATE&numShards=3&collection=implicitcoll0&shard=a&wt=javabin&version=2
[junit4] 2> 1356067 T4463 oasc.ZkController.publish publishing core=implicitcoll0_a_replica4 state=down collection=implicitcoll0
[junit4] 2> 1356068 T4463 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1356068 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356070 T4425 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:54152/z_b/q",
[junit4] 2> "core":"implicitcoll0_a_replica4",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:54152_z_b%2Fq",
[junit4] 2> "shard":"a",
[junit4] 2> "collection":"implicitcoll0",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1356072 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356102 T4464 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=implicitcoll0_b_replica4&action=CREATE&numShards=3&collection=implicitcoll0&shard=b&wt=javabin&version=2
[junit4] 2> 1356104 T4464 oasc.ZkController.publish publishing core=implicitcoll0_b_replica4 state=down collection=implicitcoll0
[junit4] 2> 1356105 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356105 T4464 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1356107 T4425 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:54152/z_b/q",
[junit4] 2> "core":"implicitcoll0_b_replica4",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:54152_z_b%2Fq",
[junit4] 2> "shard":"b",
[junit4] 2> "collection":"implicitcoll0",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1356109 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356114 T4435 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=implicitcoll0_c_replica2&action=CREATE&numShards=3&collection=implicitcoll0&shard=c&wt=javabin&version=2
[junit4] 2> 1356116 T4435 oasc.ZkController.publish publishing core=implicitcoll0_c_replica2 state=down collection=implicitcoll0
[junit4] 2> 1356117 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356117 T4435 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1356119 T4425 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:38126/z_b/q",
[junit4] 2> "core":"implicitcoll0_c_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38126_z_b%2Fq",
[junit4] 2> "shard":"c",
[junit4] 2> "collection":"implicitcoll0",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1356120 T4478 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=implicitcoll0_c_replica1&action=CREATE&numShards=3&collection=implicitcoll0&shard=c&wt=javabin&version=2
[junit4] 2> 1356121 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356122 T4450 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=implicitcoll0_b_replica5&action=CREATE&numShards=3&collection=implicitcoll0&shard=b&wt=javabin&version=2
[junit4] 2> 1356124 T4505 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=implicitcoll0_a_replica1&action=CREATE&numShards=3&collection=implicitcoll0&shard=a&wt=javabin&version=2
[junit4] 2> 1356124 T4478 oasc.ZkController.publish publishing core=implicitcoll0_c_replica1 state=down collection=implicitcoll0
[junit4] 2> 1356127 T4418 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=implicitcoll0_b_replica3&action=CREATE&numShards=3&collection=implicitcoll0&shard=b&wt=javabin&version=2
[junit4] 2> 1356128 T4478 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1356128 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356129 T4505 oasc.ZkController.publish publishing core=implicitcoll0_a_replica1 state=down collection=implicitcoll0
[junit4] 2> 1356129 T4450 oasc.ZkController.publish publishing core=implicitcoll0_b_replica5 state=down collection=implicitcoll0
[junit4] 2> 1356131 T4419 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=implicitcoll0_a_replica3&action=CREATE&numShards=3&collection=implicitcoll0&shard=a&wt=javabin&version=2
[junit4] 2> 1356133 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356133 T4450 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1356133 T4505 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1356134 T4418 oasc.ZkController.publish publishing core=implicitcoll0_b_replica3 state=down collection=implicitcoll0
[junit4] 2> 1356134 T4425 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:41601/z_b/q",
[junit4] 2> "core":"implicitcoll0_c_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:41601_z_b%2Fq",
[junit4] 2> "shard":"c",
[junit4] 2> "collection":"implicitcoll0",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1356138 T4418 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1356139 T4419 oasc.ZkController.publish publishing core=implicitcoll0_a_replica3 state=down collection=implicitcoll0
[junit4] 2> 1356140 T4419 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1356142 T4425 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:41601/z_b/q",
[junit4] 2> "core":"implicitcoll0_a_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:41601_z_b%2Fq",
[junit4] 2> "shard":"a",
[junit4] 2> "collection":"implicitcoll0",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1356144 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356145 T4425 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:53301/z_b/q",
[junit4] 2> "core":"implicitcoll0_b_replica5",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53301_z_b%2Fq",
[junit4] 2> "shard":"b",
[junit4] 2> "collection":"implicitcoll0",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1356147 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356148 T4425 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:45586/z_b/q",
[junit4] 2> "core":"implicitcoll0_b_replica3",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:45586_z_b%2Fq",
[junit4] 2> "shard":"b",
[junit4] 2> "collection":"implicitcoll0",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1356149 T4438 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=implicitcoll0_a_replica2&action=CREATE&numShards=3&collection=implicitcoll0&shard=a&wt=javabin&version=2
[junit4] 2> 1356150 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356151 T4425 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:45586/z_b/q",
[junit4] 2> "core":"implicitcoll0_a_replica3",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:45586_z_b%2Fq",
[junit4] 2> "shard":"a",
[junit4] 2> "collection":"implicitcoll0",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1356151 T4438 oasc.ZkController.publish publishing core=implicitcoll0_a_replica2 state=down collection=implicitcoll0
[junit4] 2> 1356152 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356152 T4438 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1356154 T4425 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:38126/z_b/q",
[junit4] 2> "core":"implicitcoll0_a_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38126_z_b%2Fq",
[junit4] 2> "shard":"a",
[junit4] 2> "collection":"implicitcoll0",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1356156 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356166 T4480 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=implicitcoll0_b_replica1&action=CREATE&numShards=3&collection=implicitcoll0&shard=b&wt=javabin&version=2
[junit4] 2> 1356169 T4480 oasc.ZkController.publish publishing core=implicitcoll0_b_replica1 state=down collection=implicitcoll0
[junit4] 2> 1356170 T4480 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1356172 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356173 T4425 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:41601/z_b/q",
[junit4] 2> "core":"implicitcoll0_b_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:41601_z_b%2Fq",
[junit4] 2> "shard":"b",
[junit4] 2> "collection":"implicitcoll0",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1356175 T4420 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=implicitcoll0_c_replica3&action=CREATE&numShards=3&collection=implicitcoll0&shard=c&wt=javabin&version=2
[junit4] 2> 1356175 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356177 T4420 oasc.ZkController.publish publishing core=implicitcoll0_c_replica3 state=down collection=implicitcoll0
[junit4] 2> 1356178 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356178 T4420 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1356179 T4425 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:45586/z_b/q",
[junit4] 2> "core":"implicitcoll0_c_replica3",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:45586_z_b%2Fq",
[junit4] 2> "shard":"c",
[junit4] 2> "collection":"implicitcoll0",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1356182 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356193 T4466 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=implicitcoll0_c_replica4&action=CREATE&numShards=3&collection=implicitcoll0&shard=c&wt=javabin&version=2
[junit4] 2> 1356196 T4466 oasc.ZkController.publish publishing core=implicitcoll0_c_replica4 state=down collection=implicitcoll0
[junit4] 2> 1356198 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356198 T4466 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1356199 T4425 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:54152/z_b/q",
[junit4] 2> "core":"implicitcoll0_c_replica4",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:54152_z_b%2Fq",
[junit4] 2> "shard":"c",
[junit4] 2> "collection":"implicitcoll0",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1356201 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356206 T4449 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=implicitcoll0_c_replica5&action=CREATE&numShards=3&collection=implicitcoll0&shard=c&wt=javabin&version=2
[junit4] 2> 1356209 T4449 oasc.ZkController.publish publishing core=implicitcoll0_c_replica5 state=down collection=implicitcoll0
[junit4] 2> 1356210 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356210 T4449 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1356211 T4425 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:53301/z_b/q",
[junit4] 2> "core":"implicitcoll0_c_replica5",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53301_z_b%2Fq",
[junit4] 2> "shard":"c",
[junit4] 2> "collection":"implicitcoll0",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1356213 T4424 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1356316 T4487 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1356317 T4424 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1356317 T4456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1356317 T4442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1356317 T4484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1356317 T4470 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1356317 T4489 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1356316 T4429 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1357052 T4437 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_b_replica2
[junit4] 2> 1357053 T4452 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_a_replica5
[junit4] 2> 1357054 T4437 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
[junit4] 2> 1357054 T4452 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
[junit4] 2> 1357054 T4437 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1357055 T4452 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1357055 T4452 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
[junit4] 2> 1357055 T4437 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
[junit4] 2> 1357056 T4452 oascc.ZkStateReader.readConfigName path=/collections/implicitcoll0 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1357056 T4452 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-004/implicitcoll0_a_replica5/'
[junit4] 2> 1357057 T4437 oascc.ZkStateReader.readConfigName path=/collections/implicitcoll0 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1357057 T4437 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-003/implicitcoll0_b_replica2/'
[junit4] 2> 1357069 T4463 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_a_replica4
[junit4] 2> 1357070 T4463 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
[junit4] 2> 1357071 T4463 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1357071 T4463 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
[junit4] 2> 1357072 T4463 oascc.ZkStateReader.readConfigName path=/collections/implicitcoll0 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1357072 T4463 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-005/implicitcoll0_a_replica4/'
[junit4] 2> 1357103 T4437 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 1357104 T4452 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 1357106 T4464 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_b_replica4
[junit4] 2> 1357108 T4464 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
[junit4] 2> 1357109 T4464 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1357109 T4464 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
[junit4] 2> 1357109 T4463 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 1357111 T4464 oascc.ZkStateReader.readConfigName path=/collections/implicitcoll0 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1357111 T4464 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-005/implicitcoll0_b_replica4/'
[junit4] 2> 1357125 T4435 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_c_replica2
[junit4] 2> 1357126 T4435 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
[junit4] 2> 1357129 T4478 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_c_replica1
[junit4] 2> 1357130 T4437 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1357131 T4478 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
[junit4] 2> 1357132 T4435 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1357133 T4437 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1357133 T4435 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
[junit4] 2> 1357134 T4450 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_b_replica5
[junit4] 2> 1357136 T4450 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
[junit4] 2> 1357136 T4463 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1357132 T4478 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1357137 T4435 oascc.ZkStateReader.readConfigName path=/collections/implicitcoll0 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1357137 T4478 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
[junit4] 2> 1357137 T4450 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1357139 T4450 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
[junit4] 2> 1357139 T4478 oascc.ZkStateReader.readConfigName path=/collections/implicitcoll0 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1357135 T4505 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_a_replica1
[junit4] 2> 1357139 T4450 oascc.ZkStateReader.readConfigName path=/collections/implicitcoll0 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1357139 T4478 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-006/implicitcoll0_c_replica1/'
[junit4] 2> 1357139 T4418 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_b_replica3
[junit4] 2> 1357138 T4463 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1357141 T4418 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
[junit4] 2> 1357138 T4452 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1357138 T4435 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-003/implicitcoll0_c_replica2/'
[junit4] 2> 1357142 T4418 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1357143 T4418 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
[junit4] 2> 1357142 T4419 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_a_replica3
[junit4] 2> 1357140 T4505 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
[junit4] 2> 1357140 T4450 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-004/implicitcoll0_b_replica5/'
[junit4] 2> 1357144 T4419 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
[junit4] 2> 1357145 T4505 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1357145 T4419 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1357146 T4505 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
[junit4] 2> 1357146 T4419 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
[junit4] 2> 1357147 T4418 oascc.ZkStateReader.readConfigName path=/collections/implicitcoll0 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1357147 T4452 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1357148 T4418 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-002/implicitcoll0_b_replica3/'
[junit4] 2> 1357149 T4419 oascc.ZkStateReader.readConfigName path=/collections/implicitcoll0 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1357149 T4419 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-002/implicitcoll0_a_replica3/'
[junit4] 2> 1357149 T4505 oascc.ZkStateReader.readConfigName path=/collections/implicitcoll0 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1357150 T4505 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-006/implicitcoll0_a_replica1/'
[junit4] 2> 1357153 T4438 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_a_replica2
[junit4] 2> 1357153 T4437 oass.IndexSchema.readSchema [implicitcoll0_b_replica2] Schema name=test
[junit4] 2> 1357154 T4438 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
[junit4] 2> 1357155 T4438 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1357156 T4438 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
[junit4] 2> 1357157 T4438 oascc.ZkStateReader.readConfigName path=/collections/implicitcoll0 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1357157 T4438 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-003/implicitcoll0_a_replica2/'
[junit4] 2> 1357164 T4463 oass.IndexSchema.readSchema [implicitcoll0_a_replica4] Schema name=test
[junit4] 2> 1357171 T4480 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_b_replica1
[junit4] 2> 1357172 T4480 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
[junit4] 2> 1357175 T4480 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1357176 T4480 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
[junit4] 2> 1357177 T4480 oascc.ZkStateReader.readConfigName path=/collections/implicitcoll0 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1357178 T4480 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-006/implicitcoll0_b_replica1/'
[junit4] 2> 1357179 T4464 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 1357182 T4420 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_c_replica3
[junit4] 2> 1357183 T4420 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
[junit4] 2> 1357184 T4420 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1357185 T4420 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
[junit4] 2> 1357188 T4452 oass.IndexSchema.readSchema [implicitcoll0_a_replica5] Schema name=test
[junit4] 2> 1357191 T4420 oascc.ZkStateReader.readConfigName path=/collections/implicitcoll0 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1357192 T4420 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-002/implicitcoll0_c_replica3/'
[junit4] 2> 1357210 T4466 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_c_replica4
[junit4] 2> 1357210 T4449 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_c_replica5
[junit4] 2> 1357211 T4466 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
[junit4] 2> 1357211 T4449 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
[junit4] 2> 1357212 T4466 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1357213 T4466 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
[junit4] 2> 1357218 T4449 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1357218 T4449 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
[junit4] 2> 1357219 T4466 oascc.ZkStateReader.readConfigName path=/collections/implicitcoll0 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1357219 T4466 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-005/implicitcoll0_c_replica4/'
[junit4] 2> 1357219 T4449 oascc.ZkStateReader.readConfigName path=/collections/implicitcoll0 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1357220 T4449 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001/tempDir-004/implicitcoll0_c_replica5/'
[junit4] 2> 1357230 T4464 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1357242 T4464 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1357259 T4478 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 1357271 T4435 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 1357294 T4505 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 1357297 T4438 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 1357299 T4450 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 1357302 T4478 oasc.SolrConfig.<init> Loaded
[...truncated too long message...]
.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 1386472 T4484 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 1386473 T4470 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/implicitcoll1/leader_elect/a/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 1386475 T4470 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/implicitcoll0/leader_elect/a/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.CustomCollectionTest-4F30854DB3E6369F-001
[junit4] 2> NOTE: test params are: codec=Lucene45, sim=DefaultSimilarity, locale=mt_MT, timezone=America/Maceio
[junit4] 2> NOTE: Linux 3.8.0-39-generic i386/Oracle Corporation 1.8.0_20-ea (32-bit)/cpus=8,threads=1,free=242269304,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [TestFuzzyAnalyzedSuggestions, TestSolrQueryParserDefaultOperatorResource, DocValuesMultiTest, StandardRequestHandlerTest, TestFieldTypeCollectionResource, SuggesterTSTTest, AnalysisErrorHandlingTest, TestHighlightDedupGrouping, TestAnalyzeInfixSuggestions, HdfsCollectionsAPIDistributedZkTest, UniqFieldsUpdateProcessorFactoryTest, TestCloudManagedSchema, RAMDirectoryFactoryTest, PrimUtilsTest, TestRangeQuery, TestReload, TestUpdate, IndexBasedSpellCheckerTest, HdfsBasicDistributedZk2Test, TestComponentsName, TestWordDelimiterFilterFactory, TestMaxScoreQueryParser, TestDistributedSearch, DistributedExpandComponentTest, CoreContainerCoreInitFailuresTest, DistanceFunctionTest, DisMaxRequestHandlerTest, MigrateRouteKeyTest, NoCacheHeaderTest, FileUtilsTest, TestCustomSort, OpenExchangeRatesOrgProviderTest, DeleteReplicaTest, TestFastOutputStream, TestPhraseSuggestions, PreAnalyzedFieldTest, CurrencyFieldXmlFileTest, ChaosMonkeyNothingIsSafeTest, TestRTGBase, HardAutoCommitTest, TestStressLucene, TestManagedSynonymFilterFactory, DocumentAnalysisRequestHandlerTest, TestCSVResponseWriter, OutputWriterTest, TestOmitPositions, MultiTermTest, TestSchemaNameResource, SolrCmdDistributorTest, TestManagedSchema, FullSolrCloudDistribCmdsTest, TestDefaultSimilarityFactory, TestAtomicUpdateErrorCases, ShardRoutingCustomTest, TestManagedSchemaFieldResource, RemoteQueryErrorTest, TestStressReorder, TestSolr4Spatial, TestDistribDocBasedVersion, HdfsChaosMonkeySafeLeaderTest, TestInitQParser, TestCSVLoader, TestDistributedGrouping, TestSerializedLuceneMatchVersion, ConvertedLegacyTest, TestIBSimilarityFactory, AlternateDirectoryTest, DebugComponentTest, TestBinaryField, TestNumberUtils, TestBinaryResponseWriter, TestSchemaResource, SimplePostToolTest, BadIndexSchemaTest, LeaderElectionIntegrationTest, TestZkChroot, HighlighterTest, TestCoreDiscovery, TestAnalyzedSuggestions, BlockDirectoryTest, TestStandardQParsers, DirectUpdateHandlerTest, DistribCursorPagingTest, XmlUpdateRequestHandlerTest, SolrCoreCheckLockOnStartupTest, TestXIncludeConfig, PluginInfoTest, TestMiniSolrCloudCluster, ZkNodePropsTest, TestAddFieldRealTimeGet, CurrencyFieldOpenExchangeTest, TermVectorComponentDistributedTest, TestHighFrequencyDictionaryFactory, SignatureUpdateProcessorFactoryTest, TestDynamicFieldResource, SortByFunctionTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, OpenCloseCoreStressTest, RecoveryZkTest, ZkSolrClientTest, TestRandomDVFaceting, DistributedSpellCheckComponentTest, ZkControllerTest, TestJoin, DistributedTermsComponentTest, SimpleFacetsTest, SolrCoreTest, SpellCheckComponentTest, TestFiltering, SuggesterFSTTest, SolrRequestParserTest, QueryEqualityTest, DefaultValueUpdateProcessorTest, TestSolrDeletionPolicy1, XsltUpdateRequestHandlerTest, TestQueryUtils, TestQueryTypes, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, FastVectorHighlighterTest, IndexSchemaRuntimeFieldTest, TestJmxIntegration, JSONWriterTest, QueryParsingTest, PingRequestHandlerTest, SearchHandlerTest, HighlighterConfigTest, TestQuerySenderListener, SolrIndexConfigTest, TestStressRecovery, TestCollationKeyRangeQueries, AliasIntegrationTest, ConnectionManagerTest, CustomCollectionTest]
[junit4] Completed on J1 in 38.15s, 1 test, 1 error <<< FAILURES!
[...truncated 196 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/lucene/common-build.xml:1293: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/lucene/common-build.xml:919: There were test failures: 387 suites, 1624 tests, 1 error, 37 ignored (16 assumptions)
Total time: 68 minutes 39 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0_20-ea-b11 -client -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.8-Linux (32bit/jdk1.8.0_20-ea-b11) - Build
# 127 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.8-Linux/127/
Java: 32bit/jdk1.8.0_20-ea-b11 -client -XX:+UseSerialGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch
Error Message:
No registered leader was found after waiting for 10000ms , collection: oneInstanceCollection2 slice: slice1
Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found after waiting for 10000ms , collection: oneInstanceCollection2 slice: slice1
at __randomizedtesting.SeedInfo.seed([1368C98EBE82F:81E7B894EFB48813]:0)
at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:545)
at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:519)
at org.apache.solr.cloud.BasicDistributedZkTest.testANewCollectionInOneInstanceWithManualShardAssignement(BasicDistributedZkTest.java:852)
at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:372)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
REGRESSION: org.apache.solr.cloud.OverseerRolesTest.testDistribSearch
Error Message:
could not set the new overseer . expected 127.0.0.1:59145_ current order : [127.0.0.1:59145_, 127.0.0.1:48979_, 127.0.0.1:33033_, 127.0.0.1:48443_, 127.0.0.1:32940_, 127.0.0.1:54076_, 127.0.0.1:41586_] ldr :127.0.0.1:41586_
Stack Trace:
java.lang.AssertionError: could not set the new overseer . expected 127.0.0.1:59145_ current order : [127.0.0.1:59145_, 127.0.0.1:48979_, 127.0.0.1:33033_, 127.0.0.1:48443_, 127.0.0.1:32940_, 127.0.0.1:54076_, 127.0.0.1:41586_] ldr :127.0.0.1:41586_
at __randomizedtesting.SeedInfo.seed([1368C98EBE82F:81E7B894EFB48813]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.OverseerRolesTest.testOverseerRole(OverseerRolesTest.java:159)
at org.apache.solr.cloud.OverseerRolesTest.doTest(OverseerRolesTest.java:95)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10877 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerRolesTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/init-core-data-001
[junit4] 2> 428954 T2139 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 428958 T2139 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 428959 T2139 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 428959 T2140 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 429059 T2139 oasc.ZkTestServer.run start zk server on port:45823
[junit4] 2> 429061 T2139 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 429096 T2146 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b57f5 name:ZooKeeperConnection Watcher:127.0.0.1:45823 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 429097 T2139 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 429097 T2139 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 429105 T2139 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 429107 T2148 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@105edce name:ZooKeeperConnection Watcher:127.0.0.1:45823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 429107 T2139 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 429108 T2139 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 429114 T2139 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 429118 T2139 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 429121 T2139 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 429126 T2139 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 429127 T2139 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 429132 T2139 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 429133 T2139 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 429137 T2139 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 429138 T2139 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 429141 T2139 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 429141 T2139 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 429144 T2139 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 429145 T2139 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 429148 T2139 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 429149 T2139 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 429151 T2139 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 429152 T2139 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 429154 T2139 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 429155 T2139 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 429157 T2139 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 429157 T2139 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 429160 T2139 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 429161 T2139 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 429163 T2139 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 429163 T2139 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 429577 T2139 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 429582 T2139 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:48979
[junit4] 2> 429583 T2139 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 429583 T2139 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 429584 T2139 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-002
[junit4] 2> 429585 T2139 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-002/'
[junit4] 2> 429610 T2139 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-002/solr.xml
[junit4] 2> 429635 T2139 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-002
[junit4] 2> 429636 T2139 oasc.CoreContainer.<init> New CoreContainer 21372038
[junit4] 2> 429637 T2139 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-002/]
[junit4] 2> 429638 T2139 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 429639 T2139 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 429639 T2139 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 429640 T2139 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 429640 T2139 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 429641 T2139 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 429642 T2139 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 429642 T2139 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 429643 T2139 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 429644 T2139 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 429645 T2139 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 429646 T2139 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 429647 T2139 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45823/solr
[junit4] 2> 429648 T2139 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 429653 T2139 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 429653 T2159 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63d53c name:ZooKeeperConnection Watcher:127.0.0.1:45823 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 429655 T2139 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 429664 T2139 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 429667 T2161 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@795a33 name:ZooKeeperConnection Watcher:127.0.0.1:45823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 429668 T2139 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 429670 T2139 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 429674 T2139 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 429677 T2139 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 429680 T2139 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 429684 T2139 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 429690 T2139 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 429692 T2139 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48979_
[junit4] 2> 429693 T2139 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48979_
[junit4] 2> 429698 T2139 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 429700 T2139 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 429706 T2139 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:48979_
[junit4] 2> 429706 T2139 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 429724 T2139 oasc.Overseer.start Overseer (id=91719062255370243-127.0.0.1:48979_-n_0000000000) starting
[junit4] 2> 429739 T2139 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 429747 T2163 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 429748 T2139 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 429749 T2163 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:48979_
[junit4] 2> 429751 T2139 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 429752 T2139 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 429755 T2139 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-002
[junit4] 2> 429756 T2162 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 429764 T2139 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-002/conf/
[junit4] 2> 429903 T2139 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 429904 T2139 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1
[junit4] 2> 429904 T2139 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 429905 T2139 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 429908 T2166 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ece6f6 name:ZooKeeperConnection Watcher:127.0.0.1:45823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 429909 T2139 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 429910 T2139 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 429914 T2139 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 430203 T2139 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 430204 T2139 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 430207 T2139 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:41586
[junit4] 2> 430208 T2139 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 430208 T2139 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 430208 T2139 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-003
[junit4] 2> 430209 T2139 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-003/'
[junit4] 2> 430225 T2139 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-003/solr.xml
[junit4] 2> 430243 T2139 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-003
[junit4] 2> 430243 T2139 oasc.CoreContainer.<init> New CoreContainer 32195800
[junit4] 2> 430244 T2139 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-003/]
[junit4] 2> 430244 T2139 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 430245 T2139 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 430245 T2139 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 430245 T2139 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 430246 T2139 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 430246 T2139 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 430246 T2139 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 430247 T2139 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 430247 T2139 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 430248 T2139 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 430248 T2139 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 430248 T2139 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 430249 T2139 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45823/solr
[junit4] 2> 430249 T2139 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 430250 T2139 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 430252 T2177 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1049f93 name:ZooKeeperConnection Watcher:127.0.0.1:45823 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 430253 T2139 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 430255 T2139 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 430259 T2179 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f44ebd name:ZooKeeperConnection Watcher:127.0.0.1:45823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 430259 T2139 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 430269 T2139 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 431272 T2139 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41586_
[junit4] 2> 431273 T2139 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41586_
[junit4] 2> 431277 T2161 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 431277 T2179 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 431277 T2166 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 431281 T2139 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-003
[junit4] 2> 431287 T2139 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-003/conf/
[junit4] 2> 431392 T2139 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 431394 T2139 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1
[junit4] 2> 431394 T2139 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 431661 T2139 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 431662 T2139 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 431665 T2139 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:33033
[junit4] 2> 431667 T2139 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 431667 T2139 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 431667 T2139 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-004
[junit4] 2> 431668 T2139 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-004/'
[junit4] 2> 431696 T2139 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-004/solr.xml
[junit4] 2> 431720 T2139 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-004
[junit4] 2> 431720 T2139 oasc.CoreContainer.<init> New CoreContainer 19259917
[junit4] 2> 431721 T2139 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-004/]
[junit4] 2> 431721 T2139 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 431722 T2139 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 431722 T2139 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 431722 T2139 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 431723 T2139 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 431723 T2139 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 431723 T2139 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 431724 T2139 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 431724 T2139 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 431725 T2139 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 431725 T2139 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 431725 T2139 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 431726 T2139 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45823/solr
[junit4] 2> 431726 T2139 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 431727 T2139 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 431729 T2191 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c6b46 name:ZooKeeperConnection Watcher:127.0.0.1:45823 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 431729 T2139 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 431732 T2139 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 431733 T2193 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16848fc name:ZooKeeperConnection Watcher:127.0.0.1:45823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 431733 T2139 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 431739 T2139 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 432742 T2139 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33033_
[junit4] 2> 432743 T2139 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33033_
[junit4] 2> 432747 T2161 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 432747 T2193 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 432747 T2179 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 432747 T2166 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 432753 T2139 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-004
[junit4] 2> 432765 T2139 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-004/conf/
[junit4] 2> 432879 T2139 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 432881 T2139 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1
[junit4] 2> 432881 T2139 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 433153 T2139 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 433154 T2139 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 433160 T2139 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:48443
[junit4] 2> 433161 T2139 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 433161 T2139 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 433161 T2139 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-005
[junit4] 2> 433162 T2139 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-005/'
[junit4] 2> 433191 T2139 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-005/solr.xml
[junit4] 2> 433208 T2139 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-005
[junit4] 2> 433208 T2139 oasc.CoreContainer.<init> New CoreContainer 8504705
[junit4] 2> 433209 T2139 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-005/]
[junit4] 2> 433209 T2139 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 433210 T2139 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 433210 T2139 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 433210 T2139 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 433211 T2139 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 433211 T2139 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 433211 T2139 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 433212 T2139 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 433212 T2139 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 433213 T2139 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 433213 T2139 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 433213 T2139 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 433214 T2139 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45823/solr
[junit4] 2> 433214 T2139 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 433215 T2139 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 433217 T2205 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@166402b name:ZooKeeperConnection Watcher:127.0.0.1:45823 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 433218 T2139 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 433225 T2139 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 433226 T2207 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@503dec name:ZooKeeperConnection Watcher:127.0.0.1:45823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 433227 T2139 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 433233 T2139 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 434237 T2139 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48443_
[junit4] 2> 434239 T2139 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48443_
[junit4] 2> 434241 T2207 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 434242 T2193 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 434242 T2166 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 434242 T2161 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 434242 T2179 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 434246 T2139 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-005
[junit4] 2> 434253 T2139 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-005/conf/
[junit4] 2> 434391 T2139 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 434392 T2139 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1
[junit4] 2> 434393 T2139 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 434673 T2139 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
[junit4] 2> 434674 T2139 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 434676 T2139 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54076
[junit4] 2> 434677 T2139 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 434677 T2139 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 434678 T2139 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-006
[junit4] 2> 434678 T2139 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-006/'
[junit4] 2> 434700 T2139 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-006/solr.xml
[junit4] 2> 434714 T2139 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-006
[junit4] 2> 434714 T2139 oasc.CoreContainer.<init> New CoreContainer 8075157
[junit4] 2> 434715 T2139 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-006/]
[junit4] 2> 434715 T2139 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 434716 T2139 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 434716 T2139 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 434717 T2139 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 434717 T2139 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 434718 T2139 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 434718 T2139 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 434718 T2139 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 434719 T2139 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 434719 T2139 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 434720 T2139 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 434720 T2139 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 434720 T2139 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45823/solr
[junit4] 2> 434721 T2139 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 434722 T2139 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 434724 T2219 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ad3738 name:ZooKeeperConnection Watcher:127.0.0.1:45823 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 434725 T2139 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 434730 T2139 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 434739 T2221 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5bfcd8 name:ZooKeeperConnection Watcher:127.0.0.1:45823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 434740 T2139 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 434823 T2139 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 435828 T2139 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54076_
[junit4] 2> 435829 T2139 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54076_
[junit4] 2> 435832 T2179 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 435832 T2193 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 435832 T2161 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 435832 T2166 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 435832 T2221 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 435832 T2207 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 435838 T2139 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-006
[junit4] 2> 435845 T2139 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-006/conf/
[junit4] 2> 435994 T2139 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 435995 T2139 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1
[junit4] 2> 435996 T2139 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 436296 T2139 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 5
[junit4] 2> 436297 T2139 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 436300 T2139 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59145
[junit4] 2> 436301 T2139 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 436301 T2139 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 436302 T2139 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-007
[junit4] 2> 436302 T2139 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-007/'
[junit4] 2> 436322 T2139 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-007/solr.xml
[junit4] 2> 436340 T2139 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-007
[junit4] 2> 436341 T2139 oasc.CoreContainer.<init> New CoreContainer 22947152
[junit4] 2> 436341 T2139 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-007/]
[junit4] 2> 436342 T2139 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 436342 T2139 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 436343 T2139 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 436343 T2139 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 436343 T2139 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 436344 T2139 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 436344 T2139 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 436344 T2139 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 436345 T2139 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 436345 T2139 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 436346 T2139 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 436346 T2139 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 436347 T2139 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45823/solr
[junit4] 2> 436347 T2139 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 436348 T2139 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 436350 T2233 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d718f2 name:ZooKeeperConnection Watcher:127.0.0.1:45823 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 436351 T2139 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 436353 T2139 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 436355 T2235 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1527ad9 name:ZooKeeperConnection Watcher:127.0.0.1:45823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 436355 T2139 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 436362 T2139 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 437366 T2139 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59145_
[junit4] 2> 437368 T2139 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59145_
[junit4] 2> 437375 T2207 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 437375 T2166 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 437376 T2235 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 437377 T2221 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 437376 T2161 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 437376 T2179 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 437376 T2193 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 437385 T2139 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-007
[junit4] 2> 437393 T2139 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-007/conf/
[junit4] 2> 437500 T2139 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 437502 T2139 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1
[junit4] 2> 437502 T2139 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 437803 T2139 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 6
[junit4] 2> 437804 T2139 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 437806 T2139 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:32940
[junit4] 2> 437807 T2139 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 437807 T2139 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 437807 T2139 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-008
[junit4] 2> 437808 T2139 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-008/'
[junit4] 2> 437825 T2139 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-008/solr.xml
[junit4] 2> 437837 T2139 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-008
[junit4] 2> 437837 T2139 oasc.CoreContainer.<init> New CoreContainer 15080940
[junit4] 2> 437838 T2139 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-008/]
[junit4] 2> 437838 T2139 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 437839 T2139 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 437839 T2139 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 437839 T2139 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 437840 T2139 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 437840 T2139 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 437840 T2139 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 437841 T2139 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 437841 T2139 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 437842 T2139 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 437842 T2139 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 437842 T2139 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 437843 T2139 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45823/solr
[junit4] 2> 437843 T2139 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 437844 T2139 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 437846 T2247 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@166405d name:ZooKeeperConnection Watcher:127.0.0.1:45823 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 437847 T2139 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 437849 T2139 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 437856 T2249 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c32 name:ZooKeeperConnection Watcher:127.0.0.1:45823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 437857 T2139 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 437864 T2139 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 438867 T2139 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32940_
[junit4] 2> 438868 T2139 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32940_
[junit4] 2> 438872 T2161 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 438872 T2235 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 438872 T2221 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 438872 T2179 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 438872 T2166 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 438872 T2207 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 438872 T2193 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 438876 T2249 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 438877 T2139 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-008
[junit4] 2> 438889 T2139 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-008/conf/
[junit4] 2> 439037 T2139 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 439039 T2139 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1
[junit4] 2> 439039 T2139 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 439040 T2139 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 439042 T2252 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cd3c2a name:ZooKeeperConnection Watcher:127.0.0.1:45823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 439042 T2139 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 439044 T2139 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 439046 T2139 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 439048 T2254 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1704f42 name:ZooKeeperConnection Watcher:127.0.0.1:45823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 439048 T2139 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 439050 T2139 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 439056 T2229 oasha.CollectionsHandler.handleCreateAction Creating Collection : replicationFactor=2&maxShardsPerNode=2&name=testOverseerQuit&action=CREATE&numShards=4&wt=javabin&version=2
[junit4] 2> 439057 T2161 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 439058 T2163 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"testOverseerQuit",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"4",
[junit4] 2> "maxShardsPerNode":"2"}
[junit4] 2> 439059 T2163 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"testOverseerQuit",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"4",
[junit4] 2> "maxShardsPerNode":"2"}
[junit4] 2> 439061 T2163 oasc.OverseerCollectionProcessor.createConfNode Only one config set found in zk - using it:conf1
[junit4] 2> 439061 T2163 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/testOverseerQuit
[junit4] 2> 439061 T2163 oascc.SolrZkClient.makePath makePath: /collections/testOverseerQuit
[junit4] 2> 439065 T2161 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 439067 T2162 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 439067 T2162 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: testOverseerQuit
[junit4] 2> 439067 T2162 oasc.Overseer$ClusterStateUpdater.createCollection Create collection testOverseerQuit with shards [shard1, shard2, shard3, shard4]
[junit4] 2> 439069 T2161 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 439071 T2235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 439071 T2254 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 439071 T2161 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 439071 T2249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 439071 T2179 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 439071 T2193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 439071 T2252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 439071 T2166 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 439071 T2221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 439071 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 439165 T2163 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection, shardNames [shard1, shard2, shard3, shard4] , replicationFactor : 2
[junit4] 2> 439166 T2163 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard1_replica1 as part of slice shard1 of collection testOverseerQuit on 127.0.0.1:33033_
[junit4] 2> 439167 T2163 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard1_replica2 as part of slice shard1 of collection testOverseerQuit on 127.0.0.1:48443_
[junit4] 2> 439168 T2163 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard2_replica1 as part of slice shard2 of collection testOverseerQuit on 127.0.0.1:41586_
[junit4] 2> 439170 T2187 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=testOverseerQuit_shard1_replica1&action=CREATE&numShards=4&collection=testOverseerQuit&shard=shard1&wt=javabin&version=2
[junit4] 2> 439170 T2200 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=testOverseerQuit_shard1_replica2&action=CREATE&numShards=4&collection=testOverseerQuit&shard=shard1&wt=javabin&version=2
[junit4] 2> 439171 T2187 oasc.ZkController.publish publishing core=testOverseerQuit_shard1_replica1 state=down collection=testOverseerQuit
[junit4] 2> 439171 T2163 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard2_replica2 as part of slice shard2 of collection testOverseerQuit on 127.0.0.1:32940_
[junit4] 2> 439173 T2161 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 439173 T2163 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard3_replica1 as part of slice shard3 of collection testOverseerQuit on 127.0.0.1:59145_
[junit4] 2> 439173 T2174 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=testOverseerQuit_shard2_replica1&action=CREATE&numShards=4&collection=testOverseerQuit&shard=shard2&wt=javabin&version=2
[junit4] 2> 439173 T2200 oasc.ZkController.publish publishing core=testOverseerQuit_shard1_replica2 state=down collection=testOverseerQuit
[junit4] 2> 439174 T2163 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard3_replica2 as part of slice shard3 of collection testOverseerQuit on 127.0.0.1:54076_
[junit4] 2> 439173 T2187 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 439176 T2242 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=testOverseerQuit_shard2_replica2&action=CREATE&numShards=4&collection=testOverseerQuit&shard=shard2&wt=javabin&version=2
[junit4] 2> 439176 T2161 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 439176 T2162 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 439176 T2228 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=testOverseerQuit_shard3_replica1&action=CREATE&numShards=4&collection=testOverseerQuit&shard=shard3&wt=javabin&version=2
[junit4] 2> 439176 T2200 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 439177 T2174 oasc.ZkController.publish publishing core=testOverseerQuit_shard2_replica1 state=down collection=testOverseerQuit
[junit4] 2> 439177 T2163 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard4_replica1 as part of slice shard4 of collection testOverseerQuit on 127.0.0.1:48979_
[junit4] 2> 439179 T2242 oasc.ZkController.publish publishing core=testOverseerQuit_shard2_replica2 state=down collection=testOverseerQuit
[junit4] 2> 439179 T2162 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:33033",
[junit4] 2> "core":"testOverseerQuit_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:33033_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testOverseerQuit",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 439180 T2163 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard4_replica2 as part of slice shard4 of collection testOverseerQuit on 127.0.0.1:33033_
[junit4] 2> 439180 T2242 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 439179 T2174 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 439180 T2215 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=testOverseerQuit_shard3_replica2&action=CREATE&numShards=4&collection=testOverseerQuit&shard=shard3&wt=javabin&version=2
[junit4] 2> 439182 T2154 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=testOverseerQuit_shard4_replica1&action=CREATE&numShards=4&collection=testOverseerQuit&shard=shard4&wt=javabin&version=2
[junit4] 2> 439180 T2228 oasc.ZkController.publish publishing core=testOverseerQuit_shard3_replica1 state=down collection=testOverseerQuit
[junit4] 2> 439184 T2186 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=testOverseerQuit_shard4_replica2&action=CREATE&numShards=4&collection=testOverseerQuit&shard=shard4&wt=javabin&version=2
[junit4] 2> 439184 T2161 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 439184 T2215 oasc.ZkController.publish publishing core=testOverseerQuit_shard3_replica2 state=down collection=testOverseerQuit
[junit4] 2> 439185 T2186 oasc.ZkController.publish publishing core=testOverseerQuit_shard4_replica2 state=down collection=testOverseerQuit
[junit4] 2> 439184 T2228 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 439186 T2154 oasc.ZkController.publish publishing core=testOverseerQuit_shard4_replica1 state=down collection=testOverseerQuit
[junit4] 2> 439185 T2162 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:48443",
[junit4] 2> "core":"testOverseerQuit_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:48443_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testOverseerQuit",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 439186 T2186 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 439186 T2215 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 439187 T2154 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 439189 T2162 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:41586",
[junit4] 2> "core":"testOverseerQuit_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:41586_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testOverseerQuit",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 439192 T2161 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 439193 T2162 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:32940",
[junit4] 2> "core":"testOverseerQuit_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:32940_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testOverseerQuit",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 439195 T2161 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 439196 T2162 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:59145",
[junit4] 2> "core":"testOverseerQuit_shard3_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:59145_",
[junit4] 2> "shard":"shard3",
[junit4] 2> "collection":"testOverseerQuit",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 439198 T2161 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 439199 T2162 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:54076",
[junit4] 2> "core":"testOverseerQuit_shard3_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:54076_",
[junit4] 2> "shard":"shard3",
[junit4] 2> "collection":"testOverseerQuit",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 439201 T2161 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 439202 T2162 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:33033",
[junit4] 2> "core":"testOverseerQuit_shard4_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:33033_",
[junit4] 2> "shard":"shard4",
[junit4] 2> "collection":"testOverseerQuit",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 439206 T2161 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 439207 T2162 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:48979",
[junit4] 2> "core":"testOverseerQuit_shard4_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:48979_",
[junit4] 2> "shard":"shard4",
[junit4] 2> "collection":"testOverseerQuit",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 439210 T2161 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 439313 T2235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 439313 T2161 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 439313 T2249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 439313 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 439313 T2221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 439313 T2254 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 439313 T2252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 439313 T2179 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 439313 T2166 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 439313 T2193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 440176 T2187 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard1_replica1
[junit4] 2> 440177 T2187 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
[junit4] 2> 440178 T2187 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 440178 T2187 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
[junit4] 2> 440178 T2200 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard1_replica2
[junit4] 2> 440179 T2187 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 440180 T2200 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
[junit4] 2> 440180 T2187 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-004/testOverseerQuit_shard1_replica1/'
[junit4] 2> 440180 T2200 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 440181 T2200 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
[junit4] 2> 440181 T2242 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard2_replica2
[junit4] 2> 440182 T2174 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard2_replica1
[junit4] 2> 440182 T2200 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 440182 T2242 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
[junit4] 2> 440182 T2174 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
[junit4] 2> 440182 T2200 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-005/testOverseerQuit_shard1_replica2/'
[junit4] 2> 440183 T2174 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 440183 T2242 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 440184 T2174 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
[junit4] 2> 440185 T2242 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
[junit4] 2> 440186 T2228 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard3_replica1
[junit4] 2> 440187 T2186 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard4_replica2
[junit4] 2> 440188 T2154 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard4_replica1
[junit4] 2> 440188 T2215 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerQuit_shard3_replica2
[junit4] 2> 440187 T2228 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
[junit4] 2> 440189 T2154 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
[junit4] 2> 440189 T2174 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 440190 T2174 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-003/testOverseerQuit_shard2_replica1/'
[junit4] 2> 440188 T2186 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
[junit4] 2> 440190 T2154 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 440190 T2228 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 440190 T2215 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerQuit
[junit4] 2> 440193 T2186 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 440193 T2228 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
[junit4] 2> 440193 T2242 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 440196 T2242 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-008/testOverseerQuit_shard2_replica2/'
[junit4] 2> 440193 T2154 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
[junit4] 2> 440195 T2215 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 440195 T2186 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
[junit4] 2> 440198 T2215 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerQuit
[junit4] 2> 440200 T2228 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 440200 T2228 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-007/testOverseerQuit_shard3_replica1/'
[junit4] 2> 440201 T2154 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 440201 T2154 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-002/testOverseerQuit_shard4_replica1/'
[junit4] 2> 440214 T2186 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 440215 T2186 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-004/testOverseerQuit_shard4_replica2/'
[junit4] 2> 440215 T2215 oascc.ZkStateReader.readConfigName path=/collections/testOverseerQuit configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 440216 T2215 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-1368C98EBE82F-001/tempDir-006/testOverseerQuit_shard3_replica2/'
[junit4] 2> 440243 T2187 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 440275 T2187 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 440277 T2187 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 440281 T2200 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 440302 T2154 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 440309 T2200 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 440312 T2200 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 440332 T2154 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 440334 T2154 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 440356 T2242 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 440361 T2228 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 440362 T2215 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 440366 T2174 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 440389 T2186 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 440392 T2200 oass.IndexSchema.readSchema [testOverseerQuit_shard1_replica2] Schema name=test
[junit4] 2> 440396 T2228 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 440398 T2228 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 440415 T2174 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 440418 T2174 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 440418 T2186 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 440420 T2187 oass.IndexSchema.readSchema [testOverseerQuit_shard1_replica1] Schema name=test
[junit4] 2> 440423 T2242 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 440424 T2186 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 440438 T2242 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 440444 T2215 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 440446 T2154 oass.IndexSchema.readSchema [testOverseerQuit_shard4_replica1] Schema name=test
[junit4] 2> 440462 T2215 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 440466 T2228 oass.IndexSchema.readSchema [testOverseerQuit_shard3_replica1] Schema name=test
[junit4] 2> 440471 T2186 oass.IndexSchema.readSchema [testOverseerQuit_shard4_replica2] Schema name=test
[junit4] 2> 440473 T2242 oass.IndexSchema.readSchema [testOverseerQuit_shard2_replica2] Schema name=test
[junit4] 2> 440504 T2215 oass.IndexSchema.readSchema [testOverseerQuit_shard3_replica2] Schema name=test
[junit4] 2> 440528 T2174 oass.IndexSchema.readSchema [testOverseerQuit_shard2_replica1] Schema name=test
[junit4] 2> 440807 T2200 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 440821 T2200 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 440835 T2200 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 440846 T2200 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 440874 T2200 oass.IndexSchema.readSchema
[...truncated too long message...]
sd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.BasicDistributedZkTest-1368C98EBE82F-001/collection2-004/index
[junit4] 2> 815280 T2603 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.BasicDistributedZkTest-1368C98EBE82F-001/collection2-004 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.BasicDistributedZkTest-1368C98EBE82F-001/collection2-004;done=false>>]
[junit4] 2> 815280 T2603 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.BasicDistributedZkTest-1368C98EBE82F-001/collection2-004
[junit4] 2> 815280 T2603 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection3/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 815281 T2603 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 815281 T2603 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 815281 T2603 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.BasicDistributedZkTest-1368C98EBE82F-001
[junit4] 2> NOTE: test params are: codec=Lucene46: {other_tl1=PostingsFormat(name=Asserting), SubjectTerms_mfacet=PostingsFormat(name=Asserting), n_l1=PostingsFormat(name=FSTOrdPulsing41), multiDefault=PostingsFormat(name=FSTOrdPulsing41), intDefault=PostingsFormat(name=Asserting), n_td1=PostingsFormat(name=Asserting), n_d1=PostingsFormat(name=FSTOrdPulsing41), range_facet_l=PostingsFormat(name=FSTOrdPulsing41), n_f1=PostingsFormat(name=Asserting), n_tl1=PostingsFormat(name=Asserting), oddField_s=PostingsFormat(name=MockSep), n_tf1=PostingsFormat(name=FSTOrdPulsing41), a_t=PostingsFormat(name=FSTOrdPulsing41), a_si=PostingsFormat(name=Asserting), id=PostingsFormat(name=MockSep), text=PostingsFormat(name=TestBloomFilteredLucene41Postings), timestamp=PostingsFormat(name=FSTOrdPulsing41), foo_i=PostingsFormat(name=Asserting), val_i=PostingsFormat(name=MockSep), range_facet_sl=PostingsFormat(name=MockSep), range_facet_si=PostingsFormat(name=FSTOrdPulsing41), n_dt1=PostingsFormat(name=Asserting), n_ti1=PostingsFormat(name=MockSep), rnd_b=PostingsFormat(name=MockSep), _version_=PostingsFormat(name=Asserting), foo_b=PostingsFormat(name=TestBloomFilteredLucene41Postings), n_tdt1=PostingsFormat(name=Asserting), foo_d=PostingsFormat(name=MockSep), foo_f=PostingsFormat(name=TestBloomFilteredLucene41Postings)}, docValues:{}, sim=DefaultSimilarity, locale=ar_BH, timezone=Asia/Yekaterinburg
[junit4] 2> NOTE: Linux 3.8.0-39-generic i386/Oracle Corporation 1.8.0_20-ea (32-bit)/cpus=8,threads=1,free=50798200,total=161669120
[junit4] 2> NOTE: All tests run in this JVM: [TermVectorComponentTest, CircularListTest, TestRecoveryHdfs, TestPostingsSolrHighlighter, TestSolrQueryParserResource, MBeansHandlerTest, SuggesterTest, SolrTestCaseJ4Test, IndexSchemaTest, WordBreakSolrSpellCheckerTest, StatelessScriptUpdateProcessorFactoryTest, ShardSplitTest, DistributedSpellCheckComponentTest, ZkControllerTest, CoreAdminRequestStatusTest, HdfsRecoveryZkTest, SynonymTokenizerTest, HdfsUnloadDistributedZkTest, DistributedQueryComponentOptimizationTest, OverseerStatusTest, UUIDFieldTest, DeleteShardTest, DistributedDebugComponentTest, TestRestManager, SolrInfoMBeanTest, SliceStateTest, ZkCLITest, SoftAutoCommitTest, ShowFileRequestHandlerTest, OverseerCollectionProcessorTest, TriLevelCompositeIdRoutingTest, DistributedTermsComponentTest, FileBasedSpellCheckerTest, TestPseudoReturnFields, CoreAdminHandlerTest, AutoCommitTest, TestReloadAndDeleteDocs, AsyncMigrateRouteKeyTest, TestStressVersions, EchoParamsTest, ReturnFieldsTest, BJQParserTest, DocValuesMissingTest, AddBlockUpdateTest, StressHdfsTest, TestStressUserVersions, LegacyHTMLStripCharFilterTest, QueryElevationComponentTest, TestCollationKeyRangeQueries, TestComplexPhraseQParserPlugin, HdfsBasicDistributedZkTest, SliceStateUpdateTest, TestShardHandlerFactory, LukeRequestHandlerTest, CursorMarkTest, TestFieldTypeResource, PolyFieldTest, TestCharFilters, ResponseLogComponentTest, CoreAdminCreateDiscoverTest, EnumFieldTest, RegexBoostProcessorTest, UnloadDistributedZkTest, TestSolrXMLSerializer, TestDocumentBuilder, TestJoin, TestNonDefinedSimilarityFactory, TestLMJelinekMercerSimilarityFactory, CopyFieldTest, TestTrie, TermsComponentTest, TestFieldSortValues, TestSolrDeletionPolicy1, BasicDistributedZkTest]
[junit4] Completed on J0 in 64.01s, 1 test, 1 error <<< FAILURES!
[...truncated 653 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/lucene/common-build.xml:1293: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/lucene/common-build.xml:919: There were test failures: 387 suites, 1624 tests, 1 error, 1 failure, 37 ignored (16 assumptions)
Total time: 63 minutes 44 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0_20-ea-b11 -client -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.8-Linux (32bit/jdk1.7.0_55) - Build # 126 -
Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.8-Linux/126/
Java: 32bit/jdk1.7.0_55 -client -XX:+UseSerialGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Wrong doc count on shard1_0 expected:<365> but was:<366>
Stack Trace:
java.lang.AssertionError: Wrong doc count on shard1_0 expected:<365> but was:<366>
at __randomizedtesting.SeedInfo.seed([488DD41782186EE8:C96B5A0FF5470ED4]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.ShardSplitTest.checkDocCountsAndShardStates(ShardSplitTest.java:467)
at org.apache.solr.cloud.ShardSplitTest.splitByUniqueKeyTest(ShardSplitTest.java:237)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:101)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11719 lines...]
[junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.ShardSplitTest-488DD41782186EE8-001/init-core-data-001
[junit4] 2> 1362220 T5054 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /t_/et
[junit4] 2> 1362224 T5054 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 1362224 T5054 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1362225 T5055 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1362325 T5054 oasc.ZkTestServer.run start zk server on port:40744
[junit4] 2> 1362326 T5054 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1372028 T5058 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 9701ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 1372030 T5061 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19fe70d name:ZooKeeperConnection Watcher:127.0.0.1:40744 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1372030 T5054 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1372031 T5054 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1372036 T5054 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1372037 T5063 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@192e758 name:ZooKeeperConnection Watcher:127.0.0.1:40744/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1372037 T5054 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1372038 T5054 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1372040 T5054 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1372041 T5054 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1372043 T5054 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1372045 T5054 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1372045 T5054 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1372049 T5054 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1372050 T5054 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1372052 T5054 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1372053 T5054 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1372054 T5054 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1372055 T5054 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1372057 T5054 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1372057 T5054 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1372059 T5054 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1372059 T5054 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1372061 T5054 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1372061 T5054 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1372063 T5054 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1372063 T5054 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1372065 T5054 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1372065 T5054 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1372067 T5054 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1372067 T5054 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1372069 T5054 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1372069 T5054 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1372322 T5054 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1372326 T5054 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60049
[junit4] 2> 1372328 T5054 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1372328 T5054 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1372329 T5054 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-002
[junit4] 2> 1372330 T5054 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-002/'
[junit4] 2> 1372348 T5054 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-002/solr.xml
[junit4] 2> 1372393 T5054 oasc.CoreContainer.<init> New CoreContainer 12917952
[junit4] 2> 1372394 T5054 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-002/]
[junit4] 2> 1372395 T5054 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1372395 T5054 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1372396 T5054 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1372396 T5054 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1372396 T5054 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1372397 T5054 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1372397 T5054 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1372397 T5054 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1372398 T5054 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1372398 T5054 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1372398 T5054 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1372399 T5054 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1372399 T5054 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:40744/solr
[junit4] 2> 1372400 T5054 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1372400 T5054 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1372401 T5074 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e28efb name:ZooKeeperConnection Watcher:127.0.0.1:40744 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1372402 T5054 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1372403 T5054 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1372404 T5076 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d11a8 name:ZooKeeperConnection Watcher:127.0.0.1:40744/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1372404 T5054 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1372405 T5054 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1372407 T5054 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1372409 T5054 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1372411 T5054 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1372412 T5054 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1372414 T5054 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1372415 T5054 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60049_t_%2Fet
[junit4] 2> 1372416 T5054 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60049_t_%2Fet
[junit4] 2> 1372418 T5054 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1372419 T5054 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1372421 T5054 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:60049_t_%2Fet
[junit4] 2> 1372422 T5054 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1372423 T5054 oasc.Overseer.start Overseer (id=91718344020262915-127.0.0.1:60049_t_%2Fet-n_0000000000) starting
[junit4] 2> 1372432 T5054 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1372438 T5078 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1372439 T5054 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1372439 T5078 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:60049_t_%2Fet
[junit4] 2> 1372440 T5054 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1372441 T5054 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1372443 T5077 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1372447 T5079 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 1372447 T5079 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1372448 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1372448 T5079 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1372449 T5077 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1372449 T5077 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:60049/t_/et",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:60049_t_%2Fet",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1372450 T5077 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 1372450 T5077 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1372452 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1372452 T5076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1373449 T5079 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1373449 T5079 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1373451 T5079 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1373451 T5079 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1373453 T5079 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1373453 T5079 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-002/collection1/'
[junit4] 2> 1373454 T5079 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 1373455 T5079 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 1373456 T5079 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 1373502 T5079 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 1373546 T5079 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1373548 T5079 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1373555 T5079 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1373943 T5079 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1373946 T5079 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1373947 T5079 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1373950 T5079 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1373964 T5079 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1373965 T5079 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1373965 T5079 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-002/collection1/, dataDir=./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-001/control/data/
[junit4] 2> 1373965 T5079 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12880d5
[junit4] 2> 1373966 T5079 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-001/control/data
[junit4] 2> 1373966 T5079 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-001/control/data/index/
[junit4] 2> 1373966 T5079 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 1373967 T5079 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-001/control/data/index
[junit4] 2> 1373967 T5079 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=86.310546875, floorSegmentMB=1.28125, forceMergeDeletesPctAllowed=4.538194724511322, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3055195573724274
[junit4] 2> 1373967 T5079 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6066d7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f1a585),segFN=segments_1,generation=1}
[junit4] 2> 1373968 T5079 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1373970 T5079 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1373970 T5079 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1373971 T5079 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1373971 T5079 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1373971 T5079 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1373971 T5079 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1373972 T5079 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1373972 T5079 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1373972 T5079 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1373972 T5079 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1373973 T5079 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1373973 T5079 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1373973 T5079 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1373974 T5079 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1373974 T5079 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1373975 T5079 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1373977 T5079 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1373980 T5079 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1373980 T5079 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1373981 T5079 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=85.6103515625, floorSegmentMB=1.037109375, forceMergeDeletesPctAllowed=19.693760537227305, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1743765527749767
[junit4] 2> 1373981 T5079 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6066d7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f1a585),segFN=segments_1,generation=1}
[junit4] 2> 1373981 T5079 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1373982 T5079 oass.SolrIndexSearcher.<init> Opening Searcher@1164ca5[collection1] main
[junit4] 2> 1373982 T5079 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1373983 T5079 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1373983 T5079 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1373983 T5079 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1373984 T5079 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1373984 T5079 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1373984 T5079 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1373985 T5079 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1373985 T5079 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 1373985 T5079 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1373988 T5080 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1164ca5[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1373988 T5079 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1373989 T5083 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60049/t_/et collection:control_collection shard:shard1
[junit4] 2> 1373989 T5054 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1
[junit4] 2> 1373990 T5083 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1373990 T5054 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1373991 T5054 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1373992 T5085 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13e15d8 name:ZooKeeperConnection Watcher:127.0.0.1:40744/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1373992 T5054 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1373993 T5054 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1373994 T5083 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1373995 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1373995 T5054 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1373996 T5083 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1373996 T5083 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C3183 name=collection1 org.apache.solr.core.SolrCore@1f67f1 url=http://127.0.0.1:60049/t_/et/collection1 node=127.0.0.1:60049_t_%2Fet C3183_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:60049/t_/et, core=collection1, node_name=127.0.0.1:60049_t_%2Fet}
[junit4] 2> 1373996 T5083 C3183 P60049 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60049/t_/et/collection1/
[junit4] 2> 1373997 T5083 C3183 P60049 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1373997 T5083 C3183 P60049 oasc.SyncStrategy.syncToMe http://127.0.0.1:60049/t_/et/collection1/ has no replicas
[junit4] 2> 1373997 T5083 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60049/t_/et/collection1/ shard1
[junit4] 2> 1373997 T5083 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1373998 T5077 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1374000 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1374002 T5085 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1374002 T5076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1374004 T5077 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1374005 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1374108 T5085 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1374108 T5076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1374153 T5083 oasc.ZkController.register We are http://127.0.0.1:60049/t_/et/collection1/ and leader is http://127.0.0.1:60049/t_/et/collection1/
[junit4] 2> 1374153 T5083 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60049/t_/et
[junit4] 2> 1374153 T5083 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1374154 T5083 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 1374154 T5083 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1374155 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1374155 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1374155 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1374156 T5083 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1374157 T5077 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1374157 T5077 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:60049/t_/et",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:60049_t_%2Fet",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1374159 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1374261 T5076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1374261 T5085 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1374376 T5054 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 1374377 T5054 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1374378 T5054 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59743
[junit4] 2> 1374380 T5054 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1374380 T5054 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1374381 T5054 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-003
[junit4] 2> 1374381 T5054 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-003/'
[junit4] 2> 1374401 T5054 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-003/solr.xml
[junit4] 2> 1374462 T5054 oasc.CoreContainer.<init> New CoreContainer 21658600
[junit4] 2> 1374463 T5054 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-003/]
[junit4] 2> 1374464 T5054 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1374465 T5054 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1374465 T5054 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1374465 T5054 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1374466 T5054 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1374466 T5054 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1374466 T5054 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1374467 T5054 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1374467 T5054 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1374468 T5054 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1374468 T5054 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1374468 T5054 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1374469 T5054 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:40744/solr
[junit4] 2> 1374469 T5054 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1374470 T5054 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1374471 T5096 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10cc743 name:ZooKeeperConnection Watcher:127.0.0.1:40744 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1374472 T5054 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1374474 T5054 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1374474 T5098 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ec843b name:ZooKeeperConnection Watcher:127.0.0.1:40744/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1374475 T5054 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1374479 T5054 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1375482 T5054 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59743_t_%2Fet
[junit4] 2> 1375483 T5054 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59743_t_%2Fet
[junit4] 2> 1375486 T5085 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1375487 T5098 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1375487 T5076 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1375497 T5099 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1375497 T5099 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1375502 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1375502 T5099 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1375503 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1375504 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1375504 T5077 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1375506 T5077 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:59743/t_/et",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:59743_t_%2Fet",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1375506 T5077 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 1375506 T5077 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 1375510 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1375613 T5098 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1375613 T5076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1375613 T5085 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1376503 T5099 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1376504 T5099 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1376504 T5099 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1376505 T5099 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1376506 T5099 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1376506 T5099 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-003/collection1/'
[junit4] 2> 1376507 T5099 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 1376507 T5099 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 1376507 T5099 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 1376549 T5099 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 1376616 T5099 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1376618 T5099 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1376626 T5099 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1377012 T5099 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1377015 T5099 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1377016 T5099 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1377020 T5099 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1377035 T5099 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1377036 T5099 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1377036 T5099 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-003/collection1/, dataDir=./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-001/jetty1/
[junit4] 2> 1377036 T5099 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12880d5
[junit4] 2> 1377037 T5099 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-001/jetty1
[junit4] 2> 1377037 T5099 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-001/jetty1/index/
[junit4] 2> 1377037 T5099 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 1377038 T5099 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-001/jetty1/index
[junit4] 2> 1377038 T5099 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=86.310546875, floorSegmentMB=1.28125, forceMergeDeletesPctAllowed=4.538194724511322, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3055195573724274
[junit4] 2> 1377039 T5099 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@e08946 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@177dba4),segFN=segments_1,generation=1}
[junit4] 2> 1377039 T5099 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1377041 T5099 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1377042 T5099 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1377042 T5099 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1377042 T5099 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1377043 T5099 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1377043 T5099 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1377043 T5099 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1377043 T5099 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1377044 T5099 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1377044 T5099 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1377045 T5099 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1377045 T5099 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1377045 T5099 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1377046 T5099 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1377046 T5099 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1377047 T5099 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1377049 T5099 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1377052 T5099 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1377052 T5099 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1377053 T5099 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=85.6103515625, floorSegmentMB=1.037109375, forceMergeDeletesPctAllowed=19.693760537227305, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1743765527749767
[junit4] 2> 1377053 T5099 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@e08946 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@177dba4),segFN=segments_1,generation=1}
[junit4] 2> 1377054 T5099 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1377054 T5099 oass.SolrIndexSearcher.<init> Opening Searcher@17bf2f0[collection1] main
[junit4] 2> 1377054 T5099 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1377055 T5099 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1377055 T5099 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1377056 T5099 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1377056 T5099 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1377056 T5099 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1377057 T5099 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1377057 T5099 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1377057 T5099 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 1377057 T5099 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1377061 T5100 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@17bf2f0[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1377064 T5099 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1377064 T5103 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59743/t_/et collection:collection1 shard:shard2
[junit4] 2> 1377065 T5054 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1
[junit4] 2> 1377065 T5054 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1377065 T5103 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 1377069 T5103 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 1377070 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1377071 T5103 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1377071 T5103 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 1377071 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> ASYNC NEW_CORE C3184 name=collection1 org.apache.solr.core.SolrCore@2a710c url=http://127.0.0.1:59743/t_/et/collection1 node=127.0.0.1:59743_t_%2Fet C3184_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:59743/t_/et, core=collection1, node_name=127.0.0.1:59743_t_%2Fet}
[junit4] 2> 1377071 T5103 C3184 P59743 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59743/t_/et/collection1/
[junit4] 2> 1377071 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1377072 T5103 C3184 P59743 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1377072 T5103 C3184 P59743 oasc.SyncStrategy.syncToMe http://127.0.0.1:59743/t_/et/collection1/ has no replicas
[junit4] 2> 1377072 T5103 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59743/t_/et/collection1/ shard2
[junit4] 2> 1377073 T5103 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 1377073 T5077 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1377075 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1377076 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1377080 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1377181 T5085 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1377181 T5076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1377181 T5098 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1377226 T5103 oasc.ZkController.register We are http://127.0.0.1:59743/t_/et/collection1/ and leader is http://127.0.0.1:59743/t_/et/collection1/
[junit4] 2> 1377227 T5103 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59743/t_/et
[junit4] 2> 1377227 T5103 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1377227 T5103 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 1377227 T5103 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1377228 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1377228 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1377228 T5103 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1377228 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1377230 T5077 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1377230 T5077 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:59743/t_/et",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:59743_t_%2Fet",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1377232 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1377318 T5054 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 1377319 T5054 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1377321 T5054 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:36779
[junit4] 2> 1377322 T5054 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1377322 T5054 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1377323 T5054 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-004
[junit4] 2> 1377323 T5054 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-004/'
[junit4] 2> 1377334 T5085 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1377334 T5098 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1377334 T5076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1377339 T5054 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-004/solr.xml
[junit4] 2> 1377384 T5054 oasc.CoreContainer.<init> New CoreContainer 14020054
[junit4] 2> 1377384 T5054 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-004/]
[junit4] 2> 1377386 T5054 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1377386 T5054 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1377386 T5054 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1377387 T5054 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1377387 T5054 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1377387 T5054 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1377387 T5054 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1377388 T5054 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1377388 T5054 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1377389 T5054 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1377389 T5054 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1377389 T5054 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1377390 T5054 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:40744/solr
[junit4] 2> 1377390 T5054 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1377391 T5054 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1377392 T5114 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f1a923 name:ZooKeeperConnection Watcher:127.0.0.1:40744 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1377392 T5054 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1377394 T5054 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1377395 T5116 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c63eff name:ZooKeeperConnection Watcher:127.0.0.1:40744/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1377395 T5054 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1377399 T5054 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1378401 T5054 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36779_t_%2Fet
[junit4] 2> 1378403 T5054 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36779_t_%2Fet
[junit4] 2> 1378407 T5098 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1378408 T5076 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1378408 T5085 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1378408 T5116 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1378426 T5117 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1378427 T5117 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1378428 T5117 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1378428 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1378429 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1378430 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1378432 T5077 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1378433 T5077 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:36779/t_/et",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:36779_t_%2Fet",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1378433 T5077 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 1378434 T5077 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1378437 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1378541 T5076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1378541 T5098 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1378541 T5116 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1378541 T5085 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1379429 T5117 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1379429 T5117 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1379430 T5117 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1379430 T5117 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1379431 T5117 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1379432 T5117 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-004/collection1/'
[junit4] 2> 1379432 T5117 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 1379432 T5117 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 1379433 T5117 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 1379487 T5117 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 1379533 T5117 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1379535 T5117 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1379543 T5117 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1379931 T5117 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1379934 T5117 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1379935 T5117 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1379939 T5117 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1379953 T5117 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1379953 T5117 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1379953 T5117 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-004/collection1/, dataDir=./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-001/jetty2/
[junit4] 2> 1379954 T5117 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12880d5
[junit4] 2> 1379954 T5117 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-001/jetty2
[junit4] 2> 1379955 T5117 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-001/jetty2/index/
[junit4] 2> 1379955 T5117 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 1379955 T5117 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-001/jetty2/index
[junit4] 2> 1379955 T5117 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=86.310546875, floorSegmentMB=1.28125, forceMergeDeletesPctAllowed=4.538194724511322, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3055195573724274
[junit4] 2> 1379956 T5117 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@c8eb7e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f9d641),segFN=segments_1,generation=1}
[junit4] 2> 1379956 T5117 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1379960 T5117 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1379960 T5117 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1379960 T5117 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1379961 T5117 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1379961 T5117 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1379961 T5117 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1379962 T5117 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1379962 T5117 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1379962 T5117 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1379963 T5117 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1379964 T5117 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1379964 T5117 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1379964 T5117 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1379965 T5117 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1379965 T5117 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1379966 T5117 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1379969 T5117 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1379972 T5117 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1379972 T5117 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1379973 T5117 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=85.6103515625, floorSegmentMB=1.037109375, forceMergeDeletesPctAllowed=19.693760537227305, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1743765527749767
[junit4] 2> 1379973 T5117 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@c8eb7e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f9d641),segFN=segments_1,generation=1}
[junit4] 2> 1379973 T5117 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1379974 T5117 oass.SolrIndexSearcher.<init> Opening Searcher@18793c5[collection1] main
[junit4] 2> 1379974 T5117 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1379975 T5117 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1379975 T5117 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1379975 T5117 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1379976 T5117 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1379976 T5117 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1379976 T5117 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1379977 T5117 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1379977 T5117 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 1379977 T5117 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1379981 T5118 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@18793c5[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1379983 T5117 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1379984 T5121 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36779/t_/et collection:collection1 shard:shard1
[junit4] 2> 1379984 T5054 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1
[junit4] 2> 1379985 T5054 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1379985 T5121 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1379991 T5121 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1379994 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1379994 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1379994 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1379995 T5121 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1379995 T5121 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 1379996 T5077 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C3185 name=collection1 org.apache.solr.core.SolrCore@1491ea9 url=http://127.0.0.1:36779/t_/et/collection1 node=127.0.0.1:36779_t_%2Fet C3185_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:36779/t_/et, core=collection1, node_name=127.0.0.1:36779_t_%2Fet}
[junit4] 2> 1379996 T5121 C3185 P36779 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36779/t_/et/collection1/
[junit4] 2> 1379997 T5121 C3185 P36779 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1379997 T5121 C3185 P36779 oasc.SyncStrategy.syncToMe http://127.0.0.1:36779/t_/et/collection1/ has no replicas
[junit4] 2> 1379997 T5121 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36779/t_/et/collection1/ shard1
[junit4] 2> 1379997 T5121 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1379998 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1380002 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1380005 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1380108 T5085 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1380108 T5116 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1380108 T5098 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1380108 T5076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1380153 T5121 oasc.ZkController.register We are http://127.0.0.1:36779/t_/et/collection1/ and leader is http://127.0.0.1:36779/t_/et/collection1/
[junit4] 2> 1380153 T5121 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36779/t_/et
[junit4] 2> 1380153 T5121 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1380153 T5121 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 1380154 T5121 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1380155 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1380155 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1380155 T5121 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1380155 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1380157 T5077 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1380157 T5077 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:36779/t_/et",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:36779_t_%2Fet",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 1380159 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1380245 T5054 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 1380245 T5054 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1380248 T5054 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:47313
[junit4] 2> 1380249 T5054 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1380250 T5054 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1380251 T5054 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-005
[junit4] 2> 1380251 T5054 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-005/'
[junit4] 2> 1380261 T5085 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1380261 T5116 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1380261 T5076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1380261 T5098 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1380271 T5054 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-005/solr.xml
[junit4] 2> 1380330 T5054 oasc.CoreContainer.<init> New CoreContainer 21136065
[junit4] 2> 1380331 T5054 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-005/]
[junit4] 2> 1380332 T5054 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1380332 T5054 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1380333 T5054 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1380333 T5054 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1380333 T5054 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1380334 T5054 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1380334 T5054 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1380334 T5054 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1380335 T5054 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1380335 T5054 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1380336 T5054 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1380336 T5054 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1380336 T5054 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:40744/solr
[junit4] 2> 1380337 T5054 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1380337 T5054 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1380339 T5132 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1966d59 name:ZooKeeperConnection Watcher:127.0.0.1:40744 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1380339 T5054 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1380341 T5054 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1380346 T5134 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9586fc name:ZooKeeperConnection Watcher:127.0.0.1:40744/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1380346 T5054 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1380445 T5054 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1381447 T5054 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47313_t_%2Fet
[junit4] 2> 1381449 T5054 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47313_t_%2Fet
[junit4] 2> 1381454 T5076 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1381454 T5085 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1381454 T5098 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1381454 T5134 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1381454 T5116 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1381466 T5135 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1381466 T5135 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1381468 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1381468 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1381469 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1381468 T5135 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1381471 T5077 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1381473 T5077 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:47313/t_/et",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:47313_t_%2Fet",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1381473 T5077 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 1381474 T5077 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 1381477 T5076 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1381580 T5085 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1381581 T5134 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1381581 T5116 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1381580 T5098 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1381581 T5076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1382470 T5135 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1382470 T5135 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1382472 T5135 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1382472 T5135 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1382473 T5135 oascc.ZkS
[...truncated too long message...]
org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> ASYNC NEW_CORE C3297 name=collection1 org.apache.solr.core.SolrCore@1fd6802 url=http://127.0.0.1:50764/t_/et/collection1 node=127.0.0.1:50764_t_%2Fet C3297_STATE=coll:collection1 core:collection1 props:{state=active, base_url=http://127.0.0.1:50764/t_/et, core=collection1, node_name=127.0.0.1:50764_t_%2Fet}
[junit4] 2> 1598869 T5154 C3297 P50764 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 1598870 T5154 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 1598871 T5154 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1fd6802
[junit4] 2> 1598891 T5154 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=93,cumulative_deletesById=15,cumulative_deletesByQuery=1,cumulative_errors=0,transaction_logs_total_size=5084,transaction_logs_total_number=2}
[junit4] 2> 1598893 T5154 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 1598893 T5154 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 1598893 T5154 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 1598894 T5154 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 1598895 T5154 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 1598895 T5154 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-001/jetty4 [CachedDir<<refCount=0;path=./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-001/jetty4;done=false>>]
[junit4] 2> 1598896 T5154 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-001/jetty4
[junit4] 2> 1598896 T5154 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-001/jetty4/index [CachedDir<<refCount=0;path=./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-001/jetty4/index;done=false>>]
[junit4] 2> 1598896 T5154 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.ShardSplitTest-488DD41782186EE8-001/tempDir-001/jetty4/index
[junit4] 2> 1598897 T5154 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1598897 T5154 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J1/./solr.cloud.ShardSplitTest-488DD41782186EE8-001
[junit4] 2> NOTE: test params are: codec=Lucene46: {id=PostingsFormat(name=TestBloomFilteredLucene41Postings), _version_=FSTOrd41, n_ti=PostingsFormat(name=FSTOrdPulsing41)}, docValues:{}, sim=DefaultSimilarity, locale=nl_BE, timezone=America/Menominee
[junit4] 2> NOTE: Linux 3.8.0-39-generic i386/Oracle Corporation 1.7.0_55 (32-bit)/cpus=8,threads=1,free=160318264,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [HardAutoCommitTest, DocValuesMultiTest, TestFastOutputStream, DirectUpdateHandlerTest, TestCollectionAPI, BlockCacheTest, TestAnalyzedSuggestions, SignatureUpdateProcessorFactoryTest, TestRecoveryHdfs, HdfsCollectionsAPIDistributedZkTest, FieldAnalysisRequestHandlerTest, TestCSVResponseWriter, HighlighterConfigTest, TestStressReorder, ZkSolrClientTest, DistribDocExpirationUpdateProcessorTest, SpellCheckComponentTest, TestCollationFieldDocValues, PathHierarchyTokenizerFactoryTest, TestSolrJ, XmlUpdateRequestHandlerTest, DocumentAnalysisRequestHandlerTest, DebugComponentTest, SolrRequestParserTest, TestMiniSolrCloudCluster, FullSolrCloudDistribCmdsTest, TestAddFieldRealTimeGet, TestCopyFieldCollectionResource, TestPhraseSuggestions, CursorMarkTest, TestManagedSynonymFilterFactory, CustomCollectionTest, TestStressLucene, TermVectorComponentDistributedTest, NotRequiredUniqueKeyTest, TestCoreDiscovery, TestFiltering, TestDefaultSimilarityFactory, TestFastWriter, TestCollationField, ZkNodePropsTest, TestQuerySenderNoQuery, HdfsSyncSliceTest, OpenCloseCoreStressTest, TestDistributedGrouping, TestSchemaResource, PingRequestHandlerTest, TestManagedSchema, DistributedExpandComponentTest, TestJmxIntegration, DateFieldTest, PreAnalyzedUpdateProcessorTest, TestBinaryField, AliasIntegrationTest, TestLazyCores, OutputWriterTest, HighlighterTest, XsltUpdateRequestHandlerTest, StandardRequestHandlerTest, QueryResultKeyTest, ConnectionManagerTest, PrimUtilsTest, TestSolrXmlPersistence, TestCodecSupport, TestStandardQParsers, SpellingQueryConverterTest, DisMaxRequestHandlerTest, FileUtilsTest, TestArbitraryIndexDir, SortByFunctionTest, TestUpdate, SolrCmdDistributorTest, AlternateDirectoryTest, AsyncMigrateRouteKeyTest, SolrXmlInZkTest, TestDynamicFieldCollectionResource, NumericFieldsTest, TestIndexSearcher, TestManagedResource, TestOmitPositions, TestIndexingPerformance, TestAnalyzeInfixSuggestions, TestShardHandlerFactory, BasicDistributedZk2Test, TestFieldResource, IndexSchemaRuntimeFieldTest, SolrCoreCheckLockOnStartupTest, DistanceFunctionTest, SuggesterTSTTest, HdfsBasicDistributedZkTest, TestDistributedSearch, BadIndexSchemaTest, CoreAdminRequestStatusTest, CollectionsAPIDistributedZkTest, BasicZkTest, LeaderElectionTest, TestZkChroot, TestRandomDVFaceting, DistributedSpellCheckComponentTest, ZkControllerTest, TestRealTimeGet, TestStressVersions, TestCoreContainer, StatsComponentTest, TestGroupingSearch, TestFunctionQuery, OverseerCollectionProcessorTest, CurrencyFieldXmlFileTest, SimplePostToolTest, AnalysisAfterCoreReloadTest, SpellCheckCollatorTest, CoreAdminHandlerTest, SuggesterWFSTTest, NoCacheHeaderTest, FieldMutatingUpdateProcessorTest, TestAtomicUpdateErrorCases, DefaultValueUpdateProcessorTest, SolrInfoMBeanTest, TestSurroundQueryParser, TestQueryUtils, TestQueryTypes, RequestHandlersTest, MoreLikeThisHandlerTest, FastVectorHighlighterTest, SolrPluginUtilsTest, MBeansHandlerTest, BinaryUpdateRequestHandlerTest, TestPHPSerializedResponseWriter, TestComponentsName, CoreContainerCoreInitFailuresTest, TestQuerySenderListener, SolrIndexConfigTest, TestStressRecovery, PreAnalyzedFieldTest, TestSystemIdResolver, TestSuggestSpellingConverter, DOMUtilTest, RAMDirectoryFactoryTest, TestUtils, TestDocumentBuilder, SliceStateTest, SystemInfoHandlerTest, UUIDFieldTest, CircularListTest, TestRTGBase, SolrTestCaseJ4Test, TestDistributedMissingSort, TestHighlightDedupGrouping, TestCollationKeyRangeQueries, AssignTest, DeleteInactiveReplicaTest, DeleteShardTest, DistribCursorPagingTest, ShardSplitTest]
[junit4] Completed on J1 in 237.68s, 1 test, 1 failure <<< FAILURES!
[...truncated 118 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/lucene/common-build.xml:1293: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/lucene/common-build.xml:919: There were test failures: 387 suites, 1624 tests, 1 failure, 38 ignored (17 assumptions)
Total time: 60 minutes 52 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_55 -client -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure