You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/05/24 15:01:10 UTC
[JENKINS] Lucene-Solr-4.x-Linux (32bit/ibm-j9-jdk7) - Build # 5746
- Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/5746/
Java: 32bit/ibm-j9-jdk7 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
1 tests failed.
REGRESSION: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
Server at http://127.0.0.1:46224/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:46224/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
at __randomizedtesting.SeedInfo.seed([201FBD2F856FF64B:A1F93337F2309677]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:198)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:90)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
at java.lang.reflect.Method.invoke(Method.java:613)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:780)
Build Log:
[...truncated 9346 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4] 2> 25194 T146 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 25215 T146 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404
[junit4:junit4] 2> 25223 T146 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 25226 T147 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 25436 T146 oasc.ZkTestServer.run start zk server on port:41015
[junit4:junit4] 2> 25569 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 25595 T148 oazs.NIOServerCnxn.doIO WARN Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
[junit4:junit4] 2> 27631 T155 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fd7e4735 name:ZooKeeperConnection Watcher:127.0.0.1:41015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 27632 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 27634 T146 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 27669 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 27672 T157 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2fb52689 name:ZooKeeperConnection Watcher:127.0.0.1:41015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 27672 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 27676 T146 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 27681 T146 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 27686 T146 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 27690 T146 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 27695 T146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 27696 T146 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 27702 T146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 27703 T146 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 27709 T146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 27710 T146 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 27714 T146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 27715 T146 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 27721 T146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 27722 T146 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 27728 T146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 27729 T146 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 27734 T146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 27735 T146 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 27739 T146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 27740 T146 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 27745 T146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 27746 T146 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 28057 T146 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 28063 T146 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:45451
[junit4:junit4] 2> 28064 T146 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 28065 T146 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 28066 T146 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369399172941
[junit4:junit4] 2> 28067 T146 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369399172941/solr.xml
[junit4:junit4] 2> 28068 T146 oasc.CoreContainer.<init> New CoreContainer 178491587
[junit4:junit4] 2> 28069 T146 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369399172941/'
[junit4:junit4] 2> 28070 T146 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369399172941/'
[junit4:junit4] 2> 28183 T146 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 28185 T146 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 28187 T146 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 28189 T146 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 28190 T146 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 28192 T146 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 28194 T146 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 28195 T146 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 28197 T146 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 28199 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 28229 T146 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 28230 T146 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41015/solr
[junit4:junit4] 2> 28239 T146 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 28243 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 28248 T172 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@472aafa name:ZooKeeperConnection Watcher:127.0.0.1:41015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 28249 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 28254 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 28285 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 28289 T174 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@634e87c0 name:ZooKeeperConnection Watcher:127.0.0.1:41015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 28289 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 28297 T146 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 28309 T146 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 28326 T146 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 28332 T146 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45451_
[junit4:junit4] 2> 28337 T146 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45451_
[junit4:junit4] 2> 28346 T146 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 28365 T146 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 28369 T146 oasc.Overseer.start Overseer (id=89744944041689091-127.0.0.1:45451_-n_0000000000) starting
[junit4:junit4] 2> 28379 T146 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 28390 T146 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 28395 T146 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 28398 T146 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 28410 T175 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 28412 T176 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 28426 T177 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369399172941/collection1
[junit4:junit4] 2> 28427 T177 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 28429 T177 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 28430 T177 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 28435 T177 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369399172941/collection1/'
[junit4:junit4] 2> 28436 T177 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369399172941/collection1/lib/README' to classloader
[junit4:junit4] 2> 28437 T177 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369399172941/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 28527 T177 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 28593 T177 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 28604 T177 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 28625 T177 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 29383 T177 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 29395 T177 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 29399 T177 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 29437 T177 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 29446 T177 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 29452 T177 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 29456 T177 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 29457 T177 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 29458 T177 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 29460 T177 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 29461 T177 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 29461 T177 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 29461 T177 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1369399172941/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data/
[junit4:junit4] 2> 29462 T177 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d3c35777
[junit4:junit4] 2> 29466 T177 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 29467 T177 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data
[junit4:junit4] 2> 29468 T177 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data/index/
[junit4:junit4] 2> 29468 T177 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 29469 T177 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data/index
[junit4:junit4] 2> 29472 T177 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@598a91b2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@c8de8f2b),segFN=segments_1,generation=1}
[junit4:junit4] 2> 29472 T177 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 29477 T177 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 29478 T177 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 29479 T177 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 29482 T177 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 29484 T177 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 29485 T177 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 29486 T177 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 29487 T177 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 29488 T177 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 29490 T177 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 29492 T177 oass.SolrIndexSearcher.<init> Opening Searcher@1d3af124 main
[junit4:junit4] 2> 29493 T177 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data/tlog
[junit4:junit4] 2> 29494 T177 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 29495 T177 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 29508 T178 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d3af124 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 29515 T177 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 29516 T177 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 29918 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 29920 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45451",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:45451_",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 29921 T175 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 29927 T175 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 29941 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 30518 T177 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 30519 T177 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45451 collection:control_collection shard:shard1
[junit4:junit4] 2> 30522 T177 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 30552 T177 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 30580 T177 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 30583 T177 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 30584 T177 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 30585 T177 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45451/collection1/
[junit4:junit4] 2> 30585 T177 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 30586 T177 oasc.SyncStrategy.syncToMe http://127.0.0.1:45451/collection1/ has no replicas
[junit4:junit4] 2> 30586 T177 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45451/collection1/
[junit4:junit4] 2> 30587 T177 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 31448 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 31559 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 31604 T177 oasc.ZkController.register We are http://127.0.0.1:45451/collection1/ and leader is http://127.0.0.1:45451/collection1/
[junit4:junit4] 2> 31605 T177 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45451
[junit4:junit4] 2> 31605 T177 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 31606 T177 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 31606 T177 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 31608 T177 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 31610 T146 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 31611 T146 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 31612 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 31620 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 31623 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 31626 T181 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f426e0b7 name:ZooKeeperConnection Watcher:127.0.0.1:41015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 31626 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 31628 T146 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 31632 T146 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 31720 T146 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 31723 T146 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:38199
[junit4:junit4] 2> 31724 T146 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 31724 T146 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 31725 T146 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820
[junit4:junit4] 2> 31726 T146 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/solr.xml
[junit4:junit4] 2> 31726 T146 oasc.CoreContainer.<init> New CoreContainer -726346679
[junit4:junit4] 2> 31727 T146 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/'
[junit4:junit4] 2> 31727 T146 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/'
[junit4:junit4] 2> 31784 T146 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 31785 T146 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 31786 T146 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 31786 T146 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 31787 T146 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 31788 T146 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 31788 T146 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 31789 T146 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 31790 T146 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 31791 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 31798 T146 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 31798 T146 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41015/solr
[junit4:junit4] 2> 31799 T146 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 31800 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 31802 T192 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@69afcb75 name:ZooKeeperConnection Watcher:127.0.0.1:41015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 31802 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 31804 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 31812 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 31815 T194 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@90ed4bf3 name:ZooKeeperConnection Watcher:127.0.0.1:41015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 31815 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 31821 T146 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 32828 T146 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38199_
[junit4:junit4] 2> 32830 T146 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38199_
[junit4:junit4] 2> 32833 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 32834 T181 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 32835 T194 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 32837 T174 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 32843 T195 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/collection1
[junit4:junit4] 2> 32844 T195 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 32848 T195 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 32848 T195 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 32857 T195 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/collection1/'
[junit4:junit4] 2> 32858 T195 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/collection1/lib/README' to classloader
[junit4:junit4] 2> 32859 T195 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 32896 T195 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 32936 T195 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 32938 T195 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 32945 T195 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 33066 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 33068 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45451",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:45451_",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 33075 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 33075 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 33075 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 33513 T195 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 33523 T195 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 33527 T195 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 33555 T195 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 33562 T195 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 33569 T195 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 33571 T195 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 33572 T195 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 33572 T195 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 33576 T195 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 33576 T195 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 33577 T195 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 33577 T195 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1/
[junit4:junit4] 2> 33578 T195 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d3c35777
[junit4:junit4] 2> 33579 T195 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 33580 T195 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1
[junit4:junit4] 2> 33580 T195 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1/index/
[junit4:junit4] 2> 33581 T195 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 33581 T195 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1/index
[junit4:junit4] 2> 33583 T195 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@118f417e lockFactory=org.apache.lucene.store.NativeFSLockFactory@d472e68b),segFN=segments_1,generation=1}
[junit4:junit4] 2> 33584 T195 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 33588 T195 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 33589 T195 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 33590 T195 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 33592 T195 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 33594 T195 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 33594 T195 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 33595 T195 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 33596 T195 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 33597 T195 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 33599 T195 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 33602 T195 oass.SolrIndexSearcher.<init> Opening Searcher@f27d551d main
[junit4:junit4] 2> 33602 T195 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1/tlog
[junit4:junit4] 2> 33603 T195 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 33604 T195 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 33625 T196 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f27d551d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 33630 T195 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 33630 T195 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 34584 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 34586 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:38199",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:38199_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 34586 T175 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 34586 T175 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 34635 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 34635 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 34635 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 35633 T195 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 35633 T195 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:38199 collection:collection1 shard:shard1
[junit4:junit4] 2> 35634 T195 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 35642 T195 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 35645 T195 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 35645 T195 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 35646 T195 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:38199/collection1/
[junit4:junit4] 2> 35646 T195 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 35647 T195 oasc.SyncStrategy.syncToMe http://127.0.0.1:38199/collection1/ has no replicas
[junit4:junit4] 2> 35647 T195 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:38199/collection1/
[junit4:junit4] 2> 35648 T195 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 36142 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 36151 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 36151 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 36151 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 36155 T195 oasc.ZkController.register We are http://127.0.0.1:38199/collection1/ and leader is http://127.0.0.1:38199/collection1/
[junit4:junit4] 2> 36156 T195 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38199
[junit4:junit4] 2> 36156 T195 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 36157 T195 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 36157 T195 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 36159 T195 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 36161 T146 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 36161 T146 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 36162 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 36241 T146 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 36244 T146 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:46224
[junit4:junit4] 2> 36245 T146 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 36245 T146 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 36246 T146 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369399181354
[junit4:junit4] 2> 36247 T146 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369399181354/solr.xml
[junit4:junit4] 2> 36247 T146 oasc.CoreContainer.<init> New CoreContainer 1193150784
[junit4:junit4] 2> 36248 T146 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369399181354/'
[junit4:junit4] 2> 36248 T146 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369399181354/'
[junit4:junit4] 2> 36292 T146 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 36293 T146 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 36294 T146 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 36294 T146 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 36295 T146 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 36295 T146 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 36296 T146 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 36296 T146 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 36297 T146 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 36298 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 36303 T146 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 36304 T146 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41015/solr
[junit4:junit4] 2> 36305 T146 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 36306 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 36309 T208 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d052b80 name:ZooKeeperConnection Watcher:127.0.0.1:41015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 36309 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 36311 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 36317 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 36319 T210 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4191b62b name:ZooKeeperConnection Watcher:127.0.0.1:41015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 36319 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 36324 T146 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 37329 T146 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46224_
[junit4:junit4] 2> 37330 T146 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46224_
[junit4:junit4] 2> 37333 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 37333 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 37333 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 37333 T210 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 37336 T181 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 37336 T194 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 37337 T174 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 37341 T211 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369399181354/collection1
[junit4:junit4] 2> 37341 T211 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 37342 T211 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 37342 T211 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 37344 T211 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369399181354/collection1/'
[junit4:junit4] 2> 37344 T211 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369399181354/collection1/lib/README' to classloader
[junit4:junit4] 2> 37345 T211 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369399181354/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 37369 T211 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 37399 T211 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 37401 T211 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 37406 T211 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 37658 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 37659 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:38199",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:38199_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 37670 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 37671 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 37671 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 37671 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 37750 T211 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 37756 T211 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 37759 T211 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 37778 T211 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 37783 T211 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 37788 T211 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 37789 T211 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 37789 T211 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 37790 T211 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 37791 T211 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 37792 T211 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 37792 T211 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 37793 T211 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1369399181354/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2/
[junit4:junit4] 2> 37793 T211 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d3c35777
[junit4:junit4] 2> 37794 T211 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 37794 T211 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2
[junit4:junit4] 2> 37795 T211 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2/index/
[junit4:junit4] 2> 37795 T211 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 37795 T211 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2/index
[junit4:junit4] 2> 37797 T211 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@17f45be3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7fc37ff1),segFN=segments_1,generation=1}
[junit4:junit4] 2> 37797 T211 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 37801 T211 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 37801 T211 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 37802 T211 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 37803 T211 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 37804 T211 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 37804 T211 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 37805 T211 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 37806 T211 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 37807 T211 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 37808 T211 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 37810 T211 oass.SolrIndexSearcher.<init> Opening Searcher@422cd2a5 main
[junit4:junit4] 2> 37811 T211 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2/tlog
[junit4:junit4] 2> 37812 T211 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 37812 T211 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 37824 T212 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@422cd2a5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 37830 T211 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 37830 T211 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 39179 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 39180 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46224",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "node_name":"127.0.0.1:46224_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 39181 T175 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 39181 T175 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 39189 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 39190 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 39189 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 39189 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 39832 T211 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 39833 T211 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:46224 collection:collection1 shard:shard2
[junit4:junit4] 2> 39834 T211 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 39841 T211 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 39844 T211 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 39845 T211 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 39845 T211 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:46224/collection1/
[junit4:junit4] 2> 39846 T211 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 39846 T211 oasc.SyncStrategy.syncToMe http://127.0.0.1:46224/collection1/ has no replicas
[junit4:junit4] 2> 39847 T211 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:46224/collection1/
[junit4:junit4] 2> 39847 T211 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 40696 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 40719 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 40720 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 40720 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 40720 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 40762 T211 oasc.ZkController.register We are http://127.0.0.1:46224/collection1/ and leader is http://127.0.0.1:46224/collection1/
[junit4:junit4] 2> 40762 T211 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46224
[junit4:junit4] 2> 40763 T211 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 40763 T211 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 40764 T211 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 40766 T211 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 40767 T146 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 40768 T146 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 40769 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 40902 T146 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 40905 T146 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:57633
[junit4:junit4] 2> 40906 T146 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 40907 T146 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 40908 T146 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369399185965
[junit4:junit4] 2> 40909 T146 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369399185965/solr.xml
[junit4:junit4] 2> 40910 T146 oasc.CoreContainer.<init> New CoreContainer 1797337163
[junit4:junit4] 2> 40911 T146 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369399185965/'
[junit4:junit4] 2> 40912 T146 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369399185965/'
[junit4:junit4] 2> 40978 T146 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 40980 T146 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 40981 T146 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 40982 T146 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 40983 T146 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 40984 T146 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 40985 T146 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 40986 T146 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 40987 T146 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 40988 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 40998 T146 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 41001 T146 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41015/solr
[junit4:junit4] 2> 41002 T146 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 41006 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 41008 T224 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48bac97a name:ZooKeeperConnection Watcher:127.0.0.1:41015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 41008 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 41012 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 41019 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 41023 T226 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@305c4a7 name:ZooKeeperConnection Watcher:127.0.0.1:41015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 41023 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 41030 T146 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 42034 T146 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57633_
[junit4:junit4] 2> 42037 T146 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57633_
[junit4:junit4] 2> 42040 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 42040 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 42041 T210 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 42041 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 42042 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 42043 T181 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 42041 T226 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 42045 T174 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 42046 T194 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 42052 T227 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369399185965/collection1
[junit4:junit4] 2> 42053 T227 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 42054 T227 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 42054 T227 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 42056 T227 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369399185965/collection1/'
[junit4:junit4] 2> 42056 T227 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369399185965/collection1/lib/README' to classloader
[junit4:junit4] 2> 42057 T227 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369399185965/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 42104 T227 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 42168 T227 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 42202 T227 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 42217 T227 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 42229 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 42230 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46224",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "node_name":"127.0.0.1:46224_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 42238 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 42238 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 42238 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 42239 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 42240 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 42993 T227 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 43017 T227 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 43023 T227 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 43077 T227 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 43090 T227 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 43109 T227 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 43114 T227 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 43115 T227 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 43115 T227 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 43122 T227 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 43123 T227 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 43123 T227 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 43124 T227 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1369399185965/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/
[junit4:junit4] 2> 43124 T227 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d3c35777
[junit4:junit4] 2> 43126 T227 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 43127 T227 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3
[junit4:junit4] 2> 43127 T227 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index/
[junit4:junit4] 2> 43128 T227 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 43129 T227 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index
[junit4:junit4] 2> 43132 T227 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@a7fd2ed3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@d5a6759f),segFN=segments_1,generation=1}
[junit4:junit4] 2> 43132 T227 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 43138 T227 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 43138 T227 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 43139 T227 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 43142 T227 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 43143 T227 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 43144 T227 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 43145 T227 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 43147 T227 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 43148 T227 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 43150 T227 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 43154 T227 oass.SolrIndexSearcher.<init> Opening Searcher@dbbcb5ef main
[junit4:junit4] 2> 43154 T227 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/tlog
[junit4:junit4] 2> 43156 T227 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 43156 T227 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 43174 T228 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@dbbcb5ef main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 43192 T227 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 43192 T227 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 43750 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 43751 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57633",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "node_name":"127.0.0.1:57633_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 43751 T175 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 43752 T175 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 43757 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 43757 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 43757 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 43757 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 43757 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 44200 T227 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 44200 T227 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:57633 collection:collection1 shard:shard1
[junit4:junit4] 2> 44205 T227 oasc.ZkController.register We are http://127.0.0.1:57633/collection1/ and leader is http://127.0.0.1:38199/collection1/
[junit4:junit4] 2> 44206 T227 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57633
[junit4:junit4] 2> 44206 T227 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 44207 T227 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C67 name=collection1 org.apache.solr.core.SolrCore@42344a6d url=http://127.0.0.1:57633/collection1 node=127.0.0.1:57633_ C67_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:57633, state=down, node_name=127.0.0.1:57633_, collection=collection1, core=collection1}
[junit4:junit4] 2> 44210 T229 C67 P57633 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 44210 T229 C67 P57633 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 44211 T229 C67 P57633 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 44211 T229 C67 P57633 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 44210 T227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 44213 T229 C67 P57633 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 44213 T146 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 44214 T146 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 44216 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 44227 T189 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 44377 T146 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 44383 T146 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:37229
[junit4:junit4] 2> 44388 T146 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 44389 T146 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 44390 T146 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369399189411
[junit4:junit4] 2> 44391 T146 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369399189411/solr.xml
[junit4:junit4] 2> 44393 T146 oasc.CoreContainer.<init> New CoreContainer 1003633917
[junit4:junit4] 2> 44394 T146 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369399189411/'
[junit4:junit4] 2> 44396 T146 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369399189411/'
[junit4:junit4] 2> 44494 T146 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 44496 T146 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 44497 T146 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 44499 T146 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 44501 T146 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 44502 T146 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 44504 T146 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 44505 T146 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 44507 T146 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 44513 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 44536 T146 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 44539 T146 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41015/solr
[junit4:junit4] 2> 44540 T146 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 44543 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 44556 T241 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@40c8c7fc name:ZooKeeperConnection Watcher:127.0.0.1:41015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 44560 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 44567 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 44587 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 44591 T243 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@42db5a55 name:ZooKeeperConnection Watcher:127.0.0.1:41015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 44591 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 44599 T146 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 45265 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 45267 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57633",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "node_name":"127.0.0.1:57633_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 45274 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 45274 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 45275 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 45274 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 45275 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 45274 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 45605 T146 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37229_
[junit4:junit4] 2> 45606 T146 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37229_
[junit4:junit4] 2> 45608 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 45609 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 45609 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 45609 T226 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 45609 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 45611 T210 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 45611 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 45610 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 45613 T194 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 45613 T243 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 45614 T174 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 45614 T181 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 45618 T244 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369399189411/collection1
[junit4:junit4] 2> 45619 T244 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 45619 T244 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 45620 T244 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 45621 T244 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369399189411/collection1/'
[junit4:junit4] 2> 45622 T244 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369399189411/collection1/lib/README' to classloader
[junit4:junit4] 2> 45622 T244 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369399189411/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 45651 T244 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 45684 T244 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 45686 T244 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 45691 T244 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 46228 T189 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 46229 T189 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={state=recovering&onlyIfLeader=true&checkLive=true&action=PREPRECOVERY&version=2&coreNodeName=4&wt=javabin&nodeName=127.0.0.1:57633_&core=collection1} status=0 QTime=2003
[junit4:junit4] 2> 46240 T244 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 46263 T244 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 46268 T244 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 46295 T244 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 46302 T244 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 46308 T244 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 46310 T244 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 46310 T244 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 46311 T244 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 46313 T244 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 46313 T244 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 46314 T244 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 46314 T244 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1369399189411/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/
[junit4:junit4] 2> 46315 T244 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d3c35777
[junit4:junit4] 2> 46316 T244 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 46317 T244 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4
[junit4:junit4] 2> 46318 T244 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index/
[junit4:junit4] 2> 46318 T244 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 46319 T244 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index
[junit4:junit4] 2> 46322 T244 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@118a9f31 lockFactory=org.apache.lucene.store.NativeFSLockFactory@a5c39f22),segFN=segments_1,generation=1}
[junit4:junit4] 2> 46322 T244 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 46325 T244 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 46326 T244 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 46327 T244 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 46328 T244 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 46330 T244 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 46330 T244 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 46331 T244 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 46332 T244 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 46333 T244 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 46334 T244 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 46339 T244 oass.SolrIndexSearcher.<init> Opening Searcher@593367bd main
[junit4:junit4] 2> 46341 T244 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/tlog
[junit4:junit4] 2> 46344 T244 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 46345 T244 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 46368 T245 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@593367bd main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 46376 T244 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 46377 T244 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 46780 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 46782 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:37229",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "node_name":"127.0.0.1:37229_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 46782 T175 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 46783 T175 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 46787 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 46788 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 46788 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 46787 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 46788 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 46787 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 47379 T244 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 47380 T244 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:37229 collection:collection1 shard:shard2
[junit4:junit4] 2> 47383 T244 oasc.ZkController.register We are http://127.0.0.1:37229/collection1/ and leader is http://127.0.0.1:46224/collection1/
[junit4:junit4] 2> 47384 T244 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:37229
[junit4:junit4] 2> 47384 T244 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 47385 T244 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C68 name=collection1 org.apache.solr.core.SolrCore@78f9e89a url=http://127.0.0.1:37229/collection1 node=127.0.0.1:37229_ C68_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:37229, state=down, node_name=127.0.0.1:37229_, collection=collection1, core=collection1}
[junit4:junit4] 2> 47386 T246 C68 P37229 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 47386 T246 C68 P37229 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 47386 T244 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 47387 T246 C68 P37229 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 47387 T246 C68 P37229 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 47388 T146 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 47389 T146 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 47390 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 47620 T246 C68 P37229 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 47620 T146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 47622 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 47631 T204 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 47639 T187 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/onenodecollectioncore
[junit4:junit4] 2> 47639 T187 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4] 2> 47641 T187 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4] 2> 47642 T187 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 47643 T187 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 47644 T187 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4] 2> 47648 T187 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4] 2> 47649 T187 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/onenodecollectioncore/'
[junit4:junit4] 2> 47689 T187 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 47750 T187 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 47752 T187 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 47757 T187 oass.IndexSchema.readSchema [onenodecollectioncore] Schema name=test
[junit4:junit4] 2> 48191 T187 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 48213 T187 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 48218 T187 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> ASYNC NEW_CORE C69 name=collection1 org.apache.solr.core.SolrCore@42344a6d url=http://127.0.0.1:57633/collection1 node=127.0.0.1:57633_ C69_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:57633, state=recovering, node_name=127.0.0.1:57633_, collection=collection1, shard=shard1, core=collection1}
[junit4:junit4] 2> 48230 T229 C69 P57633 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:38199/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 48234 T229 C69 P57633 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 48241 T229 C69 P57633 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:57633 START replicas=[http://127.0.0.1:38199/collection1/] nUpdates=100
[junit4:junit4] 2> 48243 T229 C69 P57633 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 48244 T229 C69 P57633 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 48244 T229 C69 P57633 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 48244 T229 C69 P57633 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 48245 T229 C69 P57633 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 48245 T229 C69 P57633 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:38199/collection1/. core=collection1
[junit4:junit4] 2> 48246 T229 C69 P57633 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 48256 T187 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> ASYNC NEW_CORE C70 name=collection1 org.apache.solr.core.SolrCore@abeec515 url=http://127.0.0.1:38199/collection1 node=127.0.0.1:38199_ C70_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:38199, state=active, node_name=127.0.0.1:38199_, collection=collection1, shard=shard1, core=collection1, leader=true}
[junit4:junit4] 2> 48260 T190 C70 P38199 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 48262 T190 C70 P38199 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@118f417e lockFactory=org.apache.lucene.store.NativeFSLockFactory@d472e68b),segFN=segments_1,generation=1}
[junit4:junit4] 2> 48263 T190 C70 P38199 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 48264 T190 C70 P38199 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@118f417e lockFactory=org.apache.lucene.store.NativeFSLockFactory@d472e68b),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@118f417e lockFactory=org.apache.lucene.store.NativeFSLockFactory@d472e68b),segFN=segments_2,generation=2}
[junit4:junit4] 2> 48264 T188 C70 P38199 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&qt=/get&distrib=false&version=2&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> 48265 T190 C70 P38199 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 48267 T190 C70 P38199 oass.SolrIndexSearcher.<init> Opening Searcher@dc3a04c3 realtime
[junit4:junit4] 2> 48267 T190 C70 P38199 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 48268 T190 C70 P38199 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={softCommit=false&commit_end_point=true&commit=true&version=2&waitSearcher=true&wt=javabin&openSearcher=false} {commit=} 0 9
[junit4:junit4] 2> 48269 T187 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 48285 T229 C69 P57633 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 48285 T187 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 48286 T229 C69 P57633 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 48293 T187 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 48296 T187 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 48296 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 48297 T187 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 48298 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:37229",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "node_name":"127.0.0.1:37229_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 48306 T187 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 48306 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 48307 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 48307 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 48308 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 48308 T187 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 48309 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 48309 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 48312 T187 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 48313 T229 C69 P57633 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 48314 T187 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1369399176820/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection/
[junit4:junit4] 2> 48316 T187 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d3c35777
[junit4:junit4] 2> 48317 T187 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 48319 T187 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection
[junit4:junit4] 2> 48320 T187 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection/index/
[junit4:junit4] 2> 48321 T187 oasc.SolrCore.initIndex WARN [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 48318 T190 C70 P38199 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 48322 T187 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection/index
[junit4:junit4] 2> 48323 T190 C70 P38199 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&version=2&command=indexversion&wt=javabin} status=0 QTime=6
[junit4:junit4] 2> 48325 T229 C69 P57633 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 48325 T229 C69 P57633 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 48326 T229 C69 P57633 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 48326 T187 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@20defd2d lockFactory=org.apache.lucene.store.NativeFSLockFactory@4bb6a476),segFN=segments_1,generation=1}
[junit4:junit4] 2> 48327 T187 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 48328 T189 C70 P38199 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&version=2&generation=2&command=filelist&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> 48330 T229 C69 P57633 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 48331 T187 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 48332 T229 C69 P57633 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index.20130524073953517
[junit4:junit4] 2> 48332 T187 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 48333 T229 C69 P57633 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@3c4e209d lockFactory=org.apache.lucene.store.NativeFSLockFactory@e0d64e52) fullCopy=false
[junit4:junit4] 2> 48334 T187 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 48336 T187 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 48340 T188 C70 P38199 oasc.SolrCore.execute [collection1] webapp= path=/replication params={checksum=true&qt=/replication&generation=2&command=filecontent&file=segments_2&wt=filestream} status=0 QTime=2
[junit4:junit4] 2> 48344 T187 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 48345 T187 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 48347 T187 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 48349 T229 C69 P57633 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 48349 T187 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 48350 T187 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 48351 T229 C69 P57633 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 48352 T229 C69 P57633 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 48353 T187 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 48356 T229 C69 P57633 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@a7fd2ed3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@d5a6759f),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@a7fd2ed3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@d5a6759f),segFN=segments_2,generation=2}
[junit4:junit4] 2> 48357 T187 oass.SolrIndexSearcher.<init> Opening Searcher@e45aac88 main
[junit4:junit4] 2> 48359 T187 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection/tlog
[junit4:junit4] 2> 48360 T187 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 48361 T187 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 48357 T229 C69 P57633 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 48366 T229 C69 P57633 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 48369 T229 C69 P57633 oass.SolrIndexSearcher.<init> Opening Searcher@a347dcf0 main
[junit4:junit4] 2> 48373 T228 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a347dcf0 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 48375 T229 C69 P57633 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index.20130524073953517 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index.20130524073953517;done=true>>]
[junit4:junit4] 2> 48376 T229 C69 P57633 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index.20130524073953517
[junit4:junit4] 2> 48376 T229 C69 P57633 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index.20130524073953517
[junit4:junit4] 2> 48377 T229 C69 P57633 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 48377 T229 C69 P57633 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 48378 T229 C69 P57633 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 48380 T229 C69 P57633 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 48379 T250 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@e45aac88 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 48384 T229 C69 P57633 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 48387 T187 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 48632 T204 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 48633 T204 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={state=recovering&onlyIfLeader=true&checkLive=true&action=PREPRECOVERY&version=2&coreNodeName=5&wt=javabin&nodeName=127.0.0.1:37229_&core=collection1} status=0 QTime=1002
[junit4:junit4] 2> 49813 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 49814 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57633",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "node_name":"127.0.0.1:57633_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 49853 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:38199",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:38199_",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"onenodecollectioncore"}
[junit4:junit4] 2> 49854 T175 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4] 2> 49854 T175 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 49859 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 49859 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 49859 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 49859 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 49859 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 49859 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 50391 T187 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4] 2> 50392 T187 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:38199 collection:onenodecollection shard:shard1
[junit4:junit4] 2> 50393 T187 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4] 2> 50401 T187 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 50403 T187 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 50404 T187 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 50404 T187 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:38199/onenodecollectioncore/
[junit4:junit4] 2> 50405 T187 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 50405 T187 oasc.SyncStrategy.syncToMe http://127.0.0.1:38199/onenodecollectioncore/ has no replicas
[junit4:junit4] 2> 50406 T187 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:38199/onenodecollectioncore/
[junit4:junit4] 2> 50406 T187 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4] 2> ASYNC NEW_CORE C71 name=collection1 org.apache.solr.core.SolrCore@78f9e89a url=http://127.0.0.1:37229/collection1 node=127.0.0.1:37229_ C71_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:37229, state=recovering, node_name=127.0.0.1:37229_, collection=collection1, shard=shard2, core=collection1}
[junit4:junit4] 2> 50635 T246 C71 P37229 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:46224/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 50635 T246 C71 P37229 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:37229 START replicas=[http://127.0.0.1:46224/collection1/] nUpdates=100
[junit4:junit4] 2> 50636 T246 C71 P37229 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 50636 T246 C71 P37229 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 50636 T246 C71 P37229 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 50637 T246 C71 P37229 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 50637 T246 C71 P37229 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 50637 T246 C71 P37229 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:46224/collection1/. core=collection1
[junit4:junit4] 2> 50638 T246 C71 P37229 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C72 name=collection1 org.apache.solr.core.SolrCore@d56d7629 url=http://127.0.0.1:46224/collection1 node=127.0.0.1:46224_ C72_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:46224, state=active, node_name=127.0.0.1:46224_, collection=collection1, shard=shard2, core=collection1, leader=true}
[junit4:junit4] 2> 50644 T206 C72 P46224 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&qt=/get&distrib=false&version=2&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> 50647 T204 C72 P46224 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 50648 T204 C72 P46224 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@17f45be3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7fc37ff1),segFN=segments_1,generation=1}
[junit4:junit4] 2> 50649 T204 C72 P46224 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 50650 T204 C72 P46224 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@17f45be3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7fc37ff1),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@17f45be3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7fc37ff1),segFN=segments_2,generation=2}
[junit4:junit4] 2> 50650 T204 C72 P46224 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 50651 T204 C72 P46224 oass.SolrIndexSearcher.<init> Opening Searcher@86deacda realtime
[junit4:junit4] 2> 50652 T204 C72 P46224 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 50652 T204 C72 P46224 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={softCommit=false&commit_end_point=true&commit=true&version=2&waitSearcher=true&wt=javabin&openSearcher=false} {commit=} 0 5
[junit4:junit4] 2> 50653 T246 C71 P37229 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 50654 T246 C71 P37229 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 50655 T206 C72 P46224 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 50656 T206 C72 P46224 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&version=2&command=indexversion&wt=javabin} status=0 QTime=1
[junit4:junit4] 2> 50657 T246 C71 P37229 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 50658 T246 C71 P37229 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 50658 T246 C71 P37229 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 50660 T204 C72 P46224 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&version=2&generation=2&command=filelist&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> 50661 T246 C71 P37229 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 50662 T246 C71 P37229 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index.20130524073955849
[junit4:junit4] 2> 50663 T246 C71 P37229 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@6363de1d lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c87207b) fullCopy=false
[junit4:junit4] 2> 50666 T203 C72 P46224 oasc.SolrCore.execute [collection1] webapp= path=/replication params={checksum=true&qt=/replication&generation=2&command=filecontent&file=segments_2&wt=filestream} status=0 QTime=1
[junit4:junit4] 2> ASYNC NEW_CORE C73 name=collection1 org.apache.solr.core.SolrCore@78f9e89a url=http://127.0.0.1:37229/collection1 node=127.0.0.1:37229_ C73_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:37229, state=recovering, node_name=127.0.0.1:37229_, collection=collection1, shard=shard2, core=collection1}
[junit4:junit4] 2> 50675 T246 C73 P37229 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 50676 T246 C73 P37229 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 50677 T246 C73 P37229 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 50678 T246 C73 P37229 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@118a9f31 lockFactory=org.apache.lucene.store.NativeFSLockFactory@a5c39f22),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@118a9f31 lockFactory=org.apache.lucene.store.NativeFSLockFactory@a5c39f22),segFN=segments_2,generation=2}
[junit4:junit4] 2> 50679 T246 C73 P37229 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 50679 T246 C73 P37229 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 50680 T246 C73 P37229 oass.SolrIndexSearcher.<init> Opening Searcher@d7985d8f main
[junit4:junit4] 2> 50681 T245 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d7985d8f main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 50682 T246 C73 P37229 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index.20130524073955849 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index.20130524073955849;done=true>>]
[junit4:junit4] 2> 50682 T246 C73 P37229 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index.20130524073955849
[junit4:junit4] 2> 50683 T246 C73 P37229 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index.20130524073955849
[junit4:junit4] 2> 50683 T246 C73 P37229 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 50683 T246 C73 P37229 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 50684 T246 C73 P37229 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 50684 T246 C73 P37229 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 50685 T246 C73 P37229 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 51369 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 51376 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:37229",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "node_name":"127.0.0.1:37229_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 51450 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 51450 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 51450 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 51450 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 51450 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 51450 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 51477 T187 oasc.ZkController.register We are http://127.0.0.1:38199/onenodecollectioncore/ and leader is http://127.0.0.1:38199/onenodecollectioncore/
[junit4:junit4] 2> 51478 T187 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:38199
[junit4:junit4] 2> 51478 T187 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 51479 T187 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4] 2> 51481 T187 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 51483 T187 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection&action=CREATE&version=2&numShards=1&name=onenodecollectioncore&wt=javabin&roles=none&collection=onenodecollection} status=0 QTime=3849
[junit4:junit4] 2> 51484 T146 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 51486 T146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 52488 T146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 52959 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 52961 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:38199",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:38199__onenodecollectioncore",
[junit4:junit4] 2> "node_name":"127.0.0.1:38199_",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"onenodecollectioncore"}
[junit4:junit4] 2> 52965 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 52965 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 52965 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 52965 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 52965 T181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 52965 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 53490 T146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 53491 T146 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4] 2> 53492 T146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 53511 T146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 53517 T254 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@911429c6 name:ZooKeeperConnection Watcher:127.0.0.1:41015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 53518 T146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 53584 T146 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 45451
[junit4:junit4] 2> 53585 T146 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=178491587
[junit4:junit4] 2> 54472 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 54473 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45451",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:45451_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 54477 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 54477 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 54477 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 54477 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 54477 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 55591 T146 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 55592 T146 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 55594 T146 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1a846202
[junit4:junit4] 2> 55603 T146 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 55604 T146 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 55605 T146 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 55606 T146 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 55607 T146 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 55608 T146 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 55609 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data/index;done=false>>]
[junit4:junit4] 2> 55609 T146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data/index
[junit4:junit4] 2> 55610 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data;done=false>>]
[junit4:junit4] 2> 55611 T146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/control/data
[junit4:junit4] 2> 55613 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 55613 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 55613 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 55613 T175 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89744944041689091-127.0.0.1:45451_-n_0000000000) am no longer a leader.
[junit4:junit4] 2> 55614 T174 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 55615 T210 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 55615 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 55615 T174 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 55617 T243 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 55617 T194 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 55618 T226 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 55619 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 55619 T194 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 55640 T146 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 55693 T146 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 38199
[junit4:junit4] 2> 55694 T146 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=-726346679
[junit4:junit4] 2> 55721 T194 oasc.Overseer.start Overseer (id=89744944041689094-127.0.0.1:38199_-n_0000000001) starting
[junit4:junit4] 2> 55725 T256 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 55727 T255 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 55729 T255 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 55731 T255 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45451",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:45451_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 55735 T255 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:38199",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:38199__onenodecollectioncore",
[junit4:junit4] 2> "node_name":"127.0.0.1:38199_",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"onenodecollectioncore"}
[junit4:junit4] 2> 55738 T255 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:38199",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:38199_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 55742 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 55742 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 55742 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 55742 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 57722 T146 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 57723 T146 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 57725 T146 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 57727 T146 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@abeec515
[junit4:junit4] 2> 57736 T146 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 57737 T146 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 57738 T146 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 57739 T146 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 57740 T146 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 57741 T146 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 57742 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1/index;done=false>>]
[junit4:junit4] 2> 57743 T146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1/index
[junit4:junit4] 2> 57744 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1;done=false>>]
[junit4:junit4] 2> 57745 T146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty1
[junit4:junit4] 2> 57746 T146 oasc.SolrCore.close [onenodecollectioncore] CLOSING SolrCore org.apache.solr.core.SolrCore@89a9f5cd
[junit4:junit4] 2> 57757 T146 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 57758 T146 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 57759 T146 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 57760 T146 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 57761 T146 oasc.SolrCore.closeSearcher [onenodecollectioncore] Closing main searcher on request.
[junit4:junit4] 2> 57762 T146 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 57763 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection/index;done=false>>]
[junit4:junit4] 2> 57763 T146 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection/index
[junit4:junit4] 2> 57764 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection;done=false>>]
[junit4:junit4] 2> 57765 T146 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1369399170404/onenodecollection
[junit4:junit4] 2> 57766 T255 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89744944041689094-127.0.0.1:38199_-n_0000000001) am no longer a leader.
[junit4:junit4] 2> 57767 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 57767 T194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 57768 T194 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 57768 T194 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 57768 T210 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 57769 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 57768 T226 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 57770 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 57770 T243 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 57772 T210 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 57772 T226 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 57775 T210 oasc.Overseer.start Overseer (id=89744944041689096-127.0.0.1:46224_-n_0000000002) starting
[junit4:junit4] 2> 57775 T226 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4:junit4] 2> 57775 T226 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4:junit4] 2> 57776 T226 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 57776 T226 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:57633/collection1/
[junit4:junit4] 2> 57777 T226 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 57777 T226 oasc.SyncStrategy.syncToMe http://127.0.0.1:57633/collection1/ has no replicas
[junit4:junit4] 2> 57777 T226 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:57633/collection1/
[junit4:junit4] 2> 57778 T226 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 57778 T258 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 57784 T257 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 57786 T257 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 57789 T257 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:38199",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:38199_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 57790 T146 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 57792 T257 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:38199",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:38199__onenodecollectioncore",
[junit4:junit4] 2> "node_name":"127.0.0.1:38199_",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"onenodecollectioncore"}
[junit4:junit4] 2> 57818 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 57818 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 57818 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 57842 T146 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 46224
[junit4:junit4] 2> 57842 T146 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1193150784
[junit4:junit4] 2> 58844 T146 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 58845 T146 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 58850 T146 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@d56d7629
[junit4:junit4] 2> 58856 T146 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 58857 T146 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 58857 T146 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 58858 T146 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 58859 T146 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 58860 T146 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 58860 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2/index;done=false>>]
[junit4:junit4] 2> 58861 T146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2/index
[junit4:junit4] 2> 58861 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2;done=false>>]
[junit4:junit4] 2> 58862 T146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty2
[junit4:junit4] 2> 58863 T257 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89744944041689096-127.0.0.1:46224_-n_0000000002) am no longer a leader.
[junit4:junit4] 2> 58866 T243 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 58866 T226 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 58868 T243 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4:junit4] 2> 58868 T243 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4:junit4] 2> 58869 T243 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 58869 T226 oasc.Overseer.start Overseer (id=89744944041689098-127.0.0.1:57633_-n_0000000003) starting
[junit4:junit4] 2> 58869 T243 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:37229/collection1/
[junit4:junit4] 2> 58870 T243 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:37229 START replicas=[http://127.0.0.1:46224/collection1/] nUpdates=100
[junit4:junit4] 2> 58871 T243 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:37229 DONE. We have no versions. sync failed.
[junit4:junit4] 2> 58871 T243 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 58872 T243 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 58872 T243 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:37229/collection1/
[junit4:junit4] 2> 58872 T243 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 58874 T261 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 58875 T226 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 58876 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 58877 T260 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 58878 T146 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 58879 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 58879 T260 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 58881 T260 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46224",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "node_name":"127.0.0.1:46224_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 58882 T243 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 58885 T260 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46224",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "node_name":"127.0.0.1:46224_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 58894 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 58894 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 58932 T146 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 57633
[junit4:junit4] 2> 58934 T146 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1797337163
[junit4:junit4] 2> 59935 T146 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 59936 T146 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 59938 T146 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@42344a6d
[junit4:junit4] 2> 59944 T146 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 59945 T146 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 59946 T146 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 59946 T146 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 59950 T146 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 59951 T146 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 59951 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3;done=false>>]
[junit4:junit4] 2> 59952 T146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3
[junit4:junit4] 2> 59953 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index;done=false>>]
[junit4:junit4] 2> 59954 T146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty3/index
[junit4:junit4] 2> 59956 T260 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89744944041689098-127.0.0.1:57633_-n_0000000003) am no longer a leader.
[junit4:junit4] 2> 59958 T243 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 59960 T243 oasc.Overseer.start Overseer (id=89744944041689100-127.0.0.1:37229_-n_0000000004) starting
[junit4:junit4] 2> 59963 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 59963 T263 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 59966 T243 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4] 2> 59967 T262 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 59968 T262 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 59969 T262 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57633",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "node_name":"127.0.0.1:57633_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 59972 T262 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57633",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "node_name":"127.0.0.1:57633_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 59977 T146 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 60030 T146 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 37229
[junit4:junit4] 2> 60031 T146 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1003633917
[junit4:junit4] 2> 60060 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 60165 T210 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 60166 T210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 60166 T210 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 61061 T146 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 61062 T146 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 61064 T146 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@78f9e89a
[junit4:junit4] 2> 61082 T146 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 61082 T146 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 61083 T146 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 61084 T146 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 61088 T146 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 61088 T146 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 61089 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index;done=false>>]
[junit4:junit4] 2> 61090 T146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4/index
[junit4:junit4] 2> 61091 T146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4;done=false>>]
[junit4:junit4] 2> 61091 T146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1369399170403/jetty4
[junit4:junit4] 2> 61093 T262 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89744944041689100-127.0.0.1:37229_-n_0000000004) am no longer a leader.
[junit4:junit4] 2> 61094 T243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 61094 T243 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 61095 T243 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 61116 T146 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 61178 T146 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 61180 T146 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:41015 41015
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 1> / (2)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr (7)
[junit4:junit4] 1> /solr/configs (1)
[junit4:junit4] 1> /solr/configs/conf1 (9)
[junit4:junit4] 1> /solr/configs/conf1/old_synonyms.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/protwords.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/stopwords.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/synonyms.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/schema.xml (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/currency.xml (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/open-exchange-rates.json (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "disclaimer": "This data is not real, it was synthetically created to match currency.xml. It is modeled after the data format available from openexchangerates.org. See https://openexchangerates.org/documentation for details",
[junit4:junit4] 1> "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4:junit4] 1> "timestamp": 1332070464,
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 1> "IMPORTANT NOTE": "In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 1> "base": "USD",
[junit4:junit4] 1> "rates": {
[junit4:junit4] 1> "USD": 1,
[junit4:junit4] 1> "JPY": 81.29,
[junit4:junit4] 1> "EUR": 2.5,
[junit4:junit4] 1> "GBP": 0.5,
[junit4:junit4] 1> "MXN": 2.0
[junit4:junit4] 1> }
[junit4:junit4] 1> }
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/configs/conf1/solrconfig.xml (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/overseer (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/overseer/queue (0)
[junit4:junit4] 1> /solr/overseer/collection-queue-work (0)
[junit4:junit4] 1> /solr/overseer/queue-work (0)
[junit4:junit4] 1> /solr/overseer_elect (2)
[junit4:junit4] 1> /solr/overseer_elect/leader (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"id":"89744944041689091-127.0.0.1:45451_-n_0000000000"}
[junit4:junit4] 1> /solr/overseer_elect/election (5)
[junit4:junit4] 1> /solr/overseer_elect/election/89744944041689094-127.0.0.1:38199_-n_0000000001 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89744944041689096-127.0.0.1:46224_-n_0000000002 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89744944041689100-127.0.0.1:37229_-n_0000000004 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89744944041689098-127.0.0.1:57633_-n_0000000003 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89744944041689091-127.0.0.1:45451_-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections (3)
[junit4:junit4] 1> /solr/collections/control_collection (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election/89744944041689091-1-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/control_collection/leaders (1)
[junit4:junit4] 1> /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "base_url":"http://127.0.0.1:45451",
[junit4:junit4] 1> "node_name":"127.0.0.1:45451_",
[junit4:junit4] 1> "core":"collection1"}
[junit4:junit4] 1> /solr/collections/control_collection/shards (0)
[junit4:junit4] 1> /solr/collections/collection1 (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/collection1/leader_elect (2)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election (2)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89744944041689094-2-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89744944041689098-4-n_0000000001 (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard2 (1)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard2/election (2)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard2/election/89744944041689096-3-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard2/election/89744944041689100-5-n_0000000001 (0)
[junit4:junit4] 1> /solr/collections/collection1/leaders (2)
[junit4:junit4] 1> /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "base_url":"http://127.0.0.1:38199",
[junit4:junit4] 1> "node_name":"127.0.0.1:38199_",
[junit4:junit4] 1> "core":"collection1"}
[junit4:junit4] 1> /solr/collections/collection1/leaders/shard2 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "base_url":"http://127.0.0.1:46224",
[junit4:junit4] 1> "node_name":"127.0.0.1:46224_",
[junit4:junit4] 1> "core":"collection1"}
[junit4:junit4] 1> /solr/collections/collection1/shards (0)
[junit4:junit4] 1> /solr/collections/onenodecollection (2)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "router":"compositeId",
[junit4:junit4] 1> "configName":"conf1"}
[junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect (1)
[junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect/shard1/election (1)
[junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect/shard1/election/89744944041689094-127.0.0.1:38199__onenodecollectioncore-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/onenodecollection/leaders (1)
[junit4:junit4] 1> /solr/collections/onenodecollection/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "base_url":"http://127.0.0.1:38199",
[junit4:junit4] 1> "node_name":"127.0.0.1:38199_",
[junit4:junit4] 1> "core":"onenodecollectioncore"}
[junit4:junit4] 1> /solr/aliases.json (0)
[junit4:junit4] 1> /solr/live_nodes (5)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:57633_ (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:38199_ (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:46224_ (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:45451_ (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:37229_ (0)
[junit4:junit4] 1> /solr/clusterstate.json (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "control_collection":{
[junit4:junit4] 1> "shards":{"shard1":{
[junit4:junit4] 1> "range":"80000000-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{"1":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:45451",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "node_name":"127.0.0.1:45451_",
[junit4:junit4] 1> "collection":"control_collection",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "leader":"true"}}}},
[junit4:junit4] 1> "router":"compositeId"},
[junit4:junit4] 1> "onenodecollection":{
[junit4:junit4] 1> "shards":{"shard1":{
[junit4:junit4] 1> "range":"80000000-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{"127.0.0.1:38199__onenodecollectioncore":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:38199",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "node_name":"127.0.0.1:38199_",
[junit4:junit4] 1> "roles":"none",
[junit4:junit4] 1> "collection":"onenodecollection",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "core":"onenodecollectioncore",
[junit4:junit4] 1> "leader":"true"}}}},
[junit4:junit4] 1> "router":"compositeId"},
[junit4:junit4] 1> "collection1":{
[junit4:junit4] 1> "shards":{
[junit4:junit4] 1> "shard1":{
[junit4:junit4] 1> "range":"80000000-ffffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{
[junit4:junit4] 1> "2":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:38199",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "node_name":"127.0.0.1:38199_",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "leader":"true"},
[junit4:junit4] 1> "4":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:57633",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "node_name":"127.0.0.1:57633_",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "core":"collection1"}}},
[junit4:junit4] 1> "shard2":{
[junit4:junit4] 1> "range":"0-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{
[junit4:junit4] 1> "3":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:46224",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "node_name":"127.0.0.1:46224_",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard":"shard2",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "leader":"true"},
[junit4:junit4] 1> "5":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:37229",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "node_name":"127.0.0.1:37229_",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard":"shard2",
[junit4:junit4] 1> "core":"collection1"}}}},
[junit4:junit4] 1> "router":"compositeId"}}
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=201FBD2F856FF64B -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=et_EE_PREEURO -Dtests.timezone=America/Bahia_Banderas -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR 36.0s J1 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:46224/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([201FBD2F856FF64B:A1F93337F2309677]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:198)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:90)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:780)
[junit4:junit4] 2> 61231 T146 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 36045 T145 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 61257 T226 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 61257 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 61258 T226 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {}, docValues:{}, sim=DefaultSimilarity, locale=et_EE_PREEURO, timezone=America/Bahia_Banderas
[junit4:junit4] 2> NOTE: Linux 3.2.0-41-generic x86/IBM Corporation 1.7.0 (32-bit)/cpus=8,threads=3,free=11008624,total=82116608
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestCollationField, SolrCmdDistributorTest, FieldAnalysisRequestHandlerTest, TestCSVLoader, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 37.00s, 1 test, 1 error <<< FAILURES!
[...truncated 890 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:386: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:379: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:437: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1243: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 1 error, 14 ignored (8 assumptions)
Total time: 45 minutes 1 second
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/ibm-j9-jdk7 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.7.0_21) - Build # 5747
- Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/5747/
Java: 64bit/jdk1.7.0_21 -XX:-UseCompressedOops -XX:+UseSerialGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
There are still nodes recoverying - waited for 230 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 230 seconds
at __randomizedtesting.SeedInfo.seed([5662BDE050A999FE:D78433F827F6F9C2]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:173)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:126)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:512)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9609 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4:junit4] 2> 438274 T1559 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /m_/bp
[junit4:junit4] 2> 438279 T1559 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-CollectionsAPIDistributedZkTest-1369404682802
[junit4:junit4] 2> 438279 T1559 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 438280 T1560 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 438380 T1559 oasc.ZkTestServer.run start zk server on port:34638
[junit4:junit4] 2> 438381 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 438562 T1566 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34d6488c name:ZooKeeperConnection Watcher:127.0.0.1:34638 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 438562 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 438563 T1559 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 438567 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 438569 T1568 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53bdd8b5 name:ZooKeeperConnection Watcher:127.0.0.1:34638/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 438569 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 438569 T1559 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 438571 T1559 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 438573 T1559 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 438575 T1559 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 438577 T1559 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 438578 T1559 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 438581 T1559 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 438581 T1559 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 438584 T1559 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 438584 T1559 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 438586 T1559 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 438587 T1559 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 438589 T1559 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 438589 T1559 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 438591 T1559 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 438591 T1559 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 438594 T1559 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 438594 T1559 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 438596 T1559 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 438597 T1559 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 438599 T1559 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 438599 T1559 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 438663 T1559 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 438666 T1559 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35380
[junit4:junit4] 2> 438666 T1559 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 438667 T1559 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 438667 T1559 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125
[junit4:junit4] 2> 438667 T1559 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/solr.xml
[junit4:junit4] 2> 438668 T1559 oasc.CoreContainer.<init> New CoreContainer 969729492
[junit4:junit4] 2> 438668 T1559 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/'
[junit4:junit4] 2> 438668 T1559 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/'
[junit4:junit4] 2> 438703 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125
[junit4:junit4] 2> 438704 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/collection1
[junit4:junit4] 2> 438705 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/collection1/conf
[junit4:junit4] 2> 438709 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/collection1/conf/xslt
[junit4:junit4] 2> 438724 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/collection1/lib
[junit4:junit4] 2> 438724 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/collection1/lib/classes
[junit4:junit4] 2> 438726 T1559 oasc.SolrCoreDiscoverer.addCore Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/conf/core.properties, adding to cores
[junit4:junit4] 2> 438727 T1559 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 438728 T1559 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 438728 T1559 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 438728 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 438729 T1559 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 438729 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 438729 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 438729 T1559 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 438730 T1559 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 438730 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 438742 T1559 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 438743 T1559 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:34638/solr
[junit4:junit4] 2> 438743 T1559 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 438744 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 438745 T1579 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6787552b name:ZooKeeperConnection Watcher:127.0.0.1:34638 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 438746 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 438747 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 438751 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 438752 T1581 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a92ebe3 name:ZooKeeperConnection Watcher:127.0.0.1:34638/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 438752 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 438754 T1559 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 438757 T1559 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 438760 T1559 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 438762 T1559 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35380_m_%2Fbp
[junit4:junit4] 2> 438764 T1559 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35380_m_%2Fbp
[junit4:junit4] 2> 438768 T1559 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 438775 T1559 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 438778 T1559 oasc.Overseer.start Overseer (id=89745305292308483-127.0.0.1:35380_m_%2Fbp-n_0000000000) starting
[junit4:junit4] 2> 438782 T1559 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 438786 T1583 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 438787 T1559 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 438790 T1559 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 438793 T1559 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 438796 T1582 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 438798 T1559 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 438798 T1559 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 438799 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 438803 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 438804 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 438806 T1586 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@64e6aeb3 name:ZooKeeperConnection Watcher:127.0.0.1:34638/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 438806 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 438807 T1559 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 438810 T1559 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 438890 T1559 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 438892 T1559 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:46286
[junit4:junit4] 2> 438892 T1559 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 438893 T1559 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 438893 T1559 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333
[junit4:junit4] 2> 438893 T1559 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/solr.xml
[junit4:junit4] 2> 438893 T1559 oasc.CoreContainer.<init> New CoreContainer 1131596076
[junit4:junit4] 2> 438894 T1559 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/'
[junit4:junit4] 2> 438894 T1559 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/'
[junit4:junit4] 2> 438930 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333
[junit4:junit4] 2> 438931 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/collection1
[junit4:junit4] 2> 438931 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/collection1/conf
[junit4:junit4] 2> 438939 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/collection1/conf/xslt
[junit4:junit4] 2> 438965 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/collection1/lib
[junit4:junit4] 2> 438966 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/collection1/lib/classes
[junit4:junit4] 2> 438967 T1559 oasc.SolrCoreDiscoverer.addCore Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/conf/core.properties, adding to cores
[junit4:junit4] 2> 438970 T1559 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 438970 T1559 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 438971 T1559 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 438971 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 438972 T1559 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 438972 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 438973 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 438973 T1559 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 438973 T1559 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 438974 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 438979 T1559 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 438979 T1559 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:34638/solr
[junit4:junit4] 2> 438980 T1559 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 438981 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 438982 T1597 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@335a77aa name:ZooKeeperConnection Watcher:127.0.0.1:34638 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 438983 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 438984 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 438989 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 438992 T1599 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@484cd89d name:ZooKeeperConnection Watcher:127.0.0.1:34638/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 438992 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 438997 T1559 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 440000 T1559 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46286_m_%2Fbp
[junit4:junit4] 2> 440001 T1559 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46286_m_%2Fbp
[junit4:junit4] 2> 440004 T1586 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 440004 T1581 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 440005 T1599 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 440009 T1559 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 440010 T1559 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 440010 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 440076 T1559 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 440078 T1559 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:44045
[junit4:junit4] 2> 440079 T1559 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 440079 T1559 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 440079 T1559 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537
[junit4:junit4] 2> 440080 T1559 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/solr.xml
[junit4:junit4] 2> 440080 T1559 oasc.CoreContainer.<init> New CoreContainer 944742903
[junit4:junit4] 2> 440080 T1559 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/'
[junit4:junit4] 2> 440081 T1559 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/'
[junit4:junit4] 2> 440124 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537
[junit4:junit4] 2> 440125 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/collection1
[junit4:junit4] 2> 440125 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/collection1/conf
[junit4:junit4] 2> 440129 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/collection1/conf/xslt
[junit4:junit4] 2> 440144 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/collection1/lib
[junit4:junit4] 2> 440145 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/collection1/lib/classes
[junit4:junit4] 2> 440146 T1559 oasc.SolrCoreDiscoverer.addCore Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/conf/core.properties, adding to cores
[junit4:junit4] 2> 440148 T1559 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 440148 T1559 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 440148 T1559 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 440149 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 440149 T1559 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 440149 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 440149 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 440150 T1559 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 440150 T1559 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 440150 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 440154 T1559 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 440154 T1559 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:34638/solr
[junit4:junit4] 2> 440154 T1559 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 440155 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 440156 T1611 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@47e0f2dc name:ZooKeeperConnection Watcher:127.0.0.1:34638 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 440157 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 440159 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 440162 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 440163 T1613 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@77cf9b72 name:ZooKeeperConnection Watcher:127.0.0.1:34638/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 440164 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 440167 T1559 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 441170 T1559 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44045_m_%2Fbp
[junit4:junit4] 2> 441171 T1559 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44045_m_%2Fbp
[junit4:junit4] 2> 441174 T1581 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 441174 T1586 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 441174 T1599 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 441175 T1613 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 441179 T1559 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 441179 T1559 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 441179 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 441243 T1559 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 441247 T1559 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52357
[junit4:junit4] 2> 441248 T1559 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 441248 T1559 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 441248 T1559 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705
[junit4:junit4] 2> 441248 T1559 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/solr.xml
[junit4:junit4] 2> 441249 T1559 oasc.CoreContainer.<init> New CoreContainer 524146838
[junit4:junit4] 2> 441249 T1559 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/'
[junit4:junit4] 2> 441249 T1559 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/'
[junit4:junit4] 2> 441291 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705
[junit4:junit4] 2> 441292 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/collection1
[junit4:junit4] 2> 441293 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/collection1/conf
[junit4:junit4] 2> 441297 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/collection1/conf/xslt
[junit4:junit4] 2> 441312 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/collection1/lib
[junit4:junit4] 2> 441312 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/collection1/lib/classes
[junit4:junit4] 2> 441314 T1559 oasc.SolrCoreDiscoverer.addCore Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/conf/core.properties, adding to cores
[junit4:junit4] 2> 441315 T1559 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 441315 T1559 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 441316 T1559 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 441316 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 441316 T1559 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 441317 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 441317 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 441317 T1559 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 441317 T1559 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 441318 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 441321 T1559 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 441321 T1559 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:34638/solr
[junit4:junit4] 2> 441322 T1559 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 441322 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 441324 T1625 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a4942c4 name:ZooKeeperConnection Watcher:127.0.0.1:34638 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 441324 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 441326 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 441330 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 441331 T1627 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7acc653 name:ZooKeeperConnection Watcher:127.0.0.1:34638/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 441331 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 441335 T1559 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 442337 T1559 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52357_m_%2Fbp
[junit4:junit4] 2> 442339 T1559 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52357_m_%2Fbp
[junit4:junit4] 2> 442342 T1581 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 442342 T1586 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 442342 T1613 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 442342 T1627 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 442342 T1599 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 442346 T1559 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 442346 T1559 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 442347 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 442410 T1559 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 442412 T1559 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56616
[junit4:junit4] 2> 442413 T1559 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 442413 T1559 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 442413 T1559 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873
[junit4:junit4] 2> 442414 T1559 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/solr.xml
[junit4:junit4] 2> 442414 T1559 oasc.CoreContainer.<init> New CoreContainer 1323448226
[junit4:junit4] 2> 442414 T1559 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/'
[junit4:junit4] 2> 442415 T1559 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/'
[junit4:junit4] 2> 442448 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873
[junit4:junit4] 2> 442449 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/collection1
[junit4:junit4] 2> 442449 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/collection1/conf
[junit4:junit4] 2> 442453 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/collection1/conf/xslt
[junit4:junit4] 2> 442468 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/collection1/lib
[junit4:junit4] 2> 442469 T1559 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/collection1/lib/classes
[junit4:junit4] 2> 442470 T1559 oasc.SolrCoreDiscoverer.addCore Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/conf/core.properties, adding to cores
[junit4:junit4] 2> 442471 T1559 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 442472 T1559 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 442472 T1559 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 442472 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 442473 T1559 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 442473 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 442473 T1559 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 442473 T1559 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 442474 T1559 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 442474 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 442477 T1559 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 442478 T1559 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:34638/solr
[junit4:junit4] 2> 442478 T1559 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 442479 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 442480 T1639 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d357bfa name:ZooKeeperConnection Watcher:127.0.0.1:34638 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 442480 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 442482 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 442486 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 442487 T1641 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f78cde1 name:ZooKeeperConnection Watcher:127.0.0.1:34638/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 442487 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 442491 T1559 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 443493 T1559 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56616_m_%2Fbp
[junit4:junit4] 2> 443494 T1559 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56616_m_%2Fbp
[junit4:junit4] 2> 443497 T1581 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 443497 T1599 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 443497 T1613 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 443497 T1586 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 443498 T1641 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 443498 T1627 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 443502 T1559 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 443503 T1559 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 443503 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 443507 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 443512 T1594 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4:junit4] 2> 443514 T1581 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 443515 T1583 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4:junit4] 2> "operation":"createcollection",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "maxShardsPerNode":null,
[junit4:junit4] 2> "createNodeSet":null,
[junit4:junit4] 2> "name":"nodes_used_collection",
[junit4:junit4] 2> "replicationFactor":"2"}
[junit4:junit4] 2> 443515 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica1 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:52357_m_%2Fbp
[junit4:junit4] 2> 443516 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica2 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:56616_m_%2Fbp
[junit4:junit4] 2> 443516 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica1 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:46286_m_%2Fbp
[junit4:junit4] 2> 443520 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica2 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:44045_m_%2Fbp
[junit4:junit4] 2> 443521 T1621 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/nodes_used_collection_shard1_replica1
[junit4:junit4] 2> 443521 T1621 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 443521 T1636 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 443522 T1636 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 443522 T1621 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 443522 T1593 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 443523 T1636 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 443523 T1609 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 443523 T1609 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 443523 T1593 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 443523 T1621 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 443524 T1609 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 443525 T1593 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 443525 T1593 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 443525 T1621 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 443523 T1636 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 443525 T1621 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 443526 T1593 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 443525 T1609 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 443526 T1593 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 443526 T1636 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 443527 T1636 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 443528 T1609 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 443528 T1609 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 443528 T1621 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 443539 T1593 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 443539 T1636 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 443539 T1609 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 443540 T1621 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/nodes_used_collection_shard1_replica1/'
[junit4:junit4] 2> 443541 T1593 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/'
[junit4:junit4] 2> 443541 T1609 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/nodes_used_collection_shard2_replica2/'
[junit4:junit4] 2> 443541 T1636 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/'
[junit4:junit4] 2> 443578 T1621 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 443589 T1636 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 443593 T1593 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 443594 T1609 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 443638 T1609 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 443639 T1609 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 443643 T1609 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica2] Schema name=test
[junit4:junit4] 2> 443652 T1621 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 443654 T1621 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 443657 T1636 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 443658 T1593 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 443659 T1621 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica1] Schema name=test
[junit4:junit4] 2> 443659 T1593 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 443659 T1636 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 443662 T1593 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica1] Schema name=test
[junit4:junit4] 2> 443664 T1636 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica2] Schema name=test
[junit4:junit4] 2> 444067 T1609 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 444073 T1609 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 444075 T1609 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 444086 T1609 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 444089 T1609 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 444098 T1609 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 444099 T1609 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 444099 T1609 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 444100 T1609 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 444101 T1609 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 444101 T1609 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 444101 T1609 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 444102 T1609 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/nodes_used_collection_shard2_replica2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/nodes_used_collection_shard2_replica2/data/
[junit4:junit4] 2> 444102 T1609 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4fb675
[junit4:junit4] 2> 444102 T1609 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 444103 T1609 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/nodes_used_collection_shard2_replica2/data
[junit4:junit4] 2> 444103 T1609 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/nodes_used_collection_shard2_replica2/data/index/
[junit4:junit4] 2> 444104 T1609 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/nodes_used_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 444104 T1609 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/nodes_used_collection_shard2_replica2/data/index
[junit4:junit4] 2> 444106 T1609 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9754d51 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6d8220),segFN=segments_1,generation=1}
[junit4:junit4] 2> 444106 T1609 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 444108 T1609 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 444109 T1609 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 444109 T1609 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 444110 T1609 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 444110 T1609 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 444110 T1609 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 444111 T1609 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 444111 T1609 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 444112 T1609 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 444114 T1609 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 444116 T1609 oass.SolrIndexSearcher.<init> Opening Searcher@79194ff5 main
[junit4:junit4] 2> 444116 T1609 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/nodes_used_collection_shard2_replica2/data/tlog
[junit4:junit4] 2> 444117 T1609 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 444117 T1609 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 444121 T1647 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica2] Registered new searcher Searcher@79194ff5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 444122 T1609 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=down
[junit4:junit4] 2> 444184 T1593 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 444189 T1593 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 444191 T1593 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 444209 T1593 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 444213 T1593 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 444217 T1593 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 444217 T1621 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 444218 T1593 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 444219 T1593 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 444219 T1593 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 444220 T1593 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 444221 T1593 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 444221 T1593 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 444221 T1593 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data/
[junit4:junit4] 2> 444222 T1593 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4fb675
[junit4:junit4] 2> 444223 T1593 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 444223 T1621 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 444223 T1593 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data
[junit4:junit4] 2> 444223 T1593 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data/index/
[junit4:junit4] 2> 444224 T1593 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 444224 T1593 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data/index
[junit4:junit4] 2> 444225 T1621 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 444226 T1593 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@74fe9f46 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3248e3cf),segFN=segments_1,generation=1}
[junit4:junit4] 2> 444227 T1593 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 444229 T1593 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 444229 T1593 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 444230 T1593 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 444230 T1593 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 444231 T1593 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 444231 T1593 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 444232 T1593 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 444232 T1593 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 444232 T1593 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 444236 T1593 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 444236 T1636 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 444236 T1621 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 444238 T1593 oass.SolrIndexSearcher.<init> Opening Searcher@18d5c8cf main
[junit4:junit4] 2> 444238 T1593 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data/tlog
[junit4:junit4] 2> 444239 T1593 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 444239 T1593 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 444241 T1621 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 444242 T1648 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica1] Registered new searcher Searcher@18d5c8cf main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 444243 T1593 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=down
[junit4:junit4] 2> 444243 T1636 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 444244 T1621 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 444245 T1621 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 444245 T1621 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 444245 T1636 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 444245 T1621 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 444247 T1621 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 444247 T1621 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 444247 T1621 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 444247 T1621 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/nodes_used_collection_shard1_replica1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/nodes_used_collection_shard1_replica1/data/
[junit4:junit4] 2> 444248 T1621 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4fb675
[junit4:junit4] 2> 444248 T1621 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 444249 T1621 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/nodes_used_collection_shard1_replica1/data
[junit4:junit4] 2> 444249 T1621 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/nodes_used_collection_shard1_replica1/data/index/
[junit4:junit4] 2> 444250 T1621 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/nodes_used_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 444250 T1621 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/nodes_used_collection_shard1_replica1/data/index
[junit4:junit4] 2> 444252 T1621 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@68f3ba82 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a23d642),segFN=segments_1,generation=1}
[junit4:junit4] 2> 444252 T1621 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 444254 T1621 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 444254 T1621 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 444255 T1621 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 444256 T1621 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 444256 T1621 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 444256 T1621 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 444256 T1636 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 444257 T1621 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 444257 T1621 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 444258 T1621 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 444260 T1621 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 444262 T1621 oass.SolrIndexSearcher.<init> Opening Searcher@7b482ad2 main
[junit4:junit4] 2> 444263 T1636 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 444263 T1621 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/nodes_used_collection_shard1_replica1/data/tlog
[junit4:junit4] 2> 444264 T1621 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 444264 T1621 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 444267 T1649 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica1] Registered new searcher Searcher@7b482ad2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 444267 T1636 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 444267 T1621 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=down
[junit4:junit4] 2> 444269 T1636 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 444269 T1636 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 444270 T1636 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 444271 T1636 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 444271 T1636 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 444271 T1636 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 444272 T1636 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data/
[junit4:junit4] 2> 444272 T1636 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4fb675
[junit4:junit4] 2> 444273 T1636 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 444274 T1636 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data
[junit4:junit4] 2> 444274 T1636 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data/index/
[junit4:junit4] 2> 444274 T1636 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 444275 T1636 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data/index
[junit4:junit4] 2> 444277 T1636 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6f328d65 lockFactory=org.apache.lucene.store.NativeFSLockFactory@123118),segFN=segments_1,generation=1}
[junit4:junit4] 2> 444277 T1636 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 444280 T1636 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 444280 T1636 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 444281 T1636 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 444282 T1636 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 444282 T1636 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 444282 T1636 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 444283 T1636 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 444283 T1636 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 444284 T1636 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 444288 T1636 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 444291 T1636 oass.SolrIndexSearcher.<init> Opening Searcher@45cf6c3 main
[junit4:junit4] 2> 444291 T1636 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data/tlog
[junit4:junit4] 2> 444292 T1636 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 444293 T1636 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 444295 T1650 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica2] Registered new searcher Searcher@45cf6c3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 444296 T1636 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=down
[junit4:junit4] 2> 444804 T1582 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 444805 T1582 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:44045_m_%2Fbp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44045/m_/bp"}
[junit4:junit4] 2> 444805 T1582 oasc.Overseer$ClusterStateUpdater.createCollection Create collection nodes_used_collection with numShards 2
[junit4:junit4] 2> 444808 T1582 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:46286_m_%2Fbp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46286/m_/bp"}
[junit4:junit4] 2> 444810 T1582 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52357_m_%2Fbp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52357/m_/bp"}
[junit4:junit4] 2> 444812 T1582 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56616_m_%2Fbp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56616/m_/bp"}
[junit4:junit4] 2> 444816 T1641 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 444816 T1613 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 444816 T1581 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 444816 T1627 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 444816 T1599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 444816 T1586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 445124 T1609 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 445125 T1609 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica2 address:http://127.0.0.1:44045/m_/bp collection:nodes_used_collection shard:shard2
[junit4:junit4] 2> 445126 T1609 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard2/election
[junit4:junit4] 2> 445131 T1609 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 445134 T1609 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=179999
[junit4:junit4] 2> 445244 T1593 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 445244 T1593 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica1 address:http://127.0.0.1:46286/m_/bp collection:nodes_used_collection shard:shard2
[junit4:junit4] 2> 445269 T1621 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica1
[junit4:junit4] 2> 445269 T1621 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica1 address:http://127.0.0.1:52357/m_/bp collection:nodes_used_collection shard:shard1
[junit4:junit4] 2> 445270 T1621 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard1/election
[junit4:junit4] 2> 445274 T1621 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 445276 T1621 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=180000
[junit4:junit4] 2> 445298 T1636 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 445298 T1636 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica2 address:http://127.0.0.1:56616/m_/bp collection:nodes_used_collection shard:shard1
[junit4:junit4] 2> 445635 T1609 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 445635 T1609 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 445635 T1609 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:44045/m_/bp/nodes_used_collection_shard2_replica2/
[junit4:junit4] 2> 445636 T1609 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:44045/m_/bp START replicas=[http://127.0.0.1:46286/m_/bp/nodes_used_collection_shard2_replica1/] nUpdates=100
[junit4:junit4] 2> 445636 T1609 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:44045/m_/bp DONE. We have no versions. sync failed.
[junit4:junit4] 2> 445637 T1609 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 445637 T1609 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 445637 T1609 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:44045/m_/bp/nodes_used_collection_shard2_replica2/
[junit4:junit4] 2> 445637 T1609 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard2
[junit4:junit4] 2> ASYNC NEW_CORE C1300 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@24623f00 url=http://127.0.0.1:46286/m_/bp/nodes_used_collection_shard2_replica1 node=127.0.0.1:46286_m_%2Fbp C1300_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=down, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:46286_m_%2Fbp, base_url=http://127.0.0.1:46286/m_/bp}
[junit4:junit4] 2> 445643 T1592 C1300 P46286 oasc.SolrCore.execute [nodes_used_collection_shard2_replica1] webapp=/m_/bp path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 445777 T1621 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 445778 T1621 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 445778 T1621 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52357/m_/bp/nodes_used_collection_shard1_replica1/
[junit4:junit4] 2> 445778 T1621 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica1 url=http://127.0.0.1:52357/m_/bp START replicas=[http://127.0.0.1:56616/m_/bp/nodes_used_collection_shard1_replica2/] nUpdates=100
[junit4:junit4] 2> 445779 T1621 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica1 url=http://127.0.0.1:52357/m_/bp DONE. We have no versions. sync failed.
[junit4:junit4] 2> 445779 T1621 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 445779 T1621 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 445779 T1621 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52357/m_/bp/nodes_used_collection_shard1_replica1/
[junit4:junit4] 2> 445780 T1621 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard1
[junit4:junit4] 2> ASYNC NEW_CORE C1301 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@8a6f3de url=http://127.0.0.1:56616/m_/bp/nodes_used_collection_shard1_replica2 node=127.0.0.1:56616_m_%2Fbp C1301_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=down, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:56616_m_%2Fbp, base_url=http://127.0.0.1:56616/m_/bp}
[junit4:junit4] 2> 445784 T1635 C1301 P56616 oasc.SolrCore.execute [nodes_used_collection_shard1_replica2] webapp=/m_/bp path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 446332 T1582 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 446343 T1641 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 446344 T1627 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 446344 T1613 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 446344 T1586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 446343 T1599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 446343 T1581 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 446349 T1593 oasc.ZkController.register We are http://127.0.0.1:46286/m_/bp/nodes_used_collection_shard2_replica1/ and leader is http://127.0.0.1:44045/m_/bp/nodes_used_collection_shard2_replica2/
[junit4:junit4] 2> 446349 T1593 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica1 baseURL=http://127.0.0.1:46286/m_/bp
[junit4:junit4] 2> 446350 T1593 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 446350 T1593 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> 446350 T1653 C1300 P46286 oasc.RecoveryStrategy.run Starting recovery process. core=nodes_used_collection_shard2_replica1 recoveringAfterStartup=true
[junit4:junit4] 2> 446350 T1653 C1300 P46286 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 446351 T1593 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 446351 T1653 C1300 P46286 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=recovering
[junit4:junit4] 2> 446352 T1593 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=2830
[junit4:junit4] 2> 446352 T1653 C1300 P46286 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 446353 T1636 oasc.ZkController.register We are http://127.0.0.1:56616/m_/bp/nodes_used_collection_shard1_replica2/ and leader is http://127.0.0.1:52357/m_/bp/nodes_used_collection_shard1_replica1/
[junit4:junit4] 2> 446353 T1636 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica2 baseURL=http://127.0.0.1:56616/m_/bp
[junit4:junit4] 2> 446353 T1636 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 446353 T1636 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> 446354 T1654 C1301 P56616 oasc.RecoveryStrategy.run Starting recovery process. core=nodes_used_collection_shard1_replica2 recoveringAfterStartup=true
[junit4:junit4] 2> 446354 T1654 C1301 P56616 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 446354 T1636 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 446354 T1654 C1301 P56616 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=recovering
[junit4:junit4] 2> 446355 T1636 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=2834
[junit4:junit4] 2> 446356 T1654 C1301 P56616 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 446357 T1607 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:46286_m_%2Fbp_nodes_used_collection_shard2_replica1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 446360 T1622 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:56616_m_%2Fbp_nodes_used_collection_shard1_replica2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 446386 T1621 oasc.ZkController.register We are http://127.0.0.1:52357/m_/bp/nodes_used_collection_shard1_replica1/ and leader is http://127.0.0.1:52357/m_/bp/nodes_used_collection_shard1_replica1/
[junit4:junit4] 2> 446387 T1621 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica1 baseURL=http://127.0.0.1:52357/m_/bp
[junit4:junit4] 2> 446387 T1621 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 446387 T1621 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=active
[junit4:junit4] 2> 446389 T1621 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 446390 T1621 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=2869
[junit4:junit4] 2> 446395 T1609 oasc.ZkController.register We are http://127.0.0.1:44045/m_/bp/nodes_used_collection_shard2_replica2/ and leader is http://127.0.0.1:44045/m_/bp/nodes_used_collection_shard2_replica2/
[junit4:junit4] 2> 446396 T1609 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica2 baseURL=http://127.0.0.1:44045/m_/bp
[junit4:junit4] 2> 446396 T1609 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 446396 T1609 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=active
[junit4:junit4] 2> 446398 T1609 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 446399 T1609 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=2876
[junit4:junit4] 2> 446399 T1583 oasc.OverseerCollectionProcessor.createCollection Finished create command on all shards for collection: nodes_used_collection
[junit4:junit4] 2> 446404 T1599 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work/qnr-0000000000 state: SyncConnected type NodeDataChanged
[junit4:junit4] 2> 446405 T1581 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 446406 T1583 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000000 complete, response:{success={null={responseHeader={status=0,QTime=2830},core=nodes_used_collection_shard2_replica1},null={responseHeader={status=0,QTime=2834},core=nodes_used_collection_shard1_replica2},null={responseHeader={status=0,QTime=2869},core=nodes_used_collection_shard1_replica1},null={responseHeader={status=0,QTime=2876},core=nodes_used_collection_shard2_replica2}}}
[junit4:junit4] 2> 446407 T1594 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2} status=0 QTime=2896
[junit4:junit4] 2> 446408 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 446409 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 446410 T1656 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3ac90fdc name:ZooKeeperConnection Watcher:127.0.0.1:34638/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 446410 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 446411 T1559 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 446413 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 446414 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 446416 T1658 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@667b27b7 name:ZooKeeperConnection Watcher:127.0.0.1:34638/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 446416 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 446418 T1559 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 446423 T1620 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=1&maxShardsPerNode=1&name=awholynewcollection_0&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4:junit4] 2> 446424 T1581 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 446425 T1583 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000002 message:{
[junit4:junit4] 2> "operation":"createcollection",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "maxShardsPerNode":"1",
[junit4:junit4] 2> "createNodeSet":null,
[junit4:junit4] 2> "name":"awholynewcollection_0",
[junit4:junit4] 2> "replicationFactor":"2"}
[junit4:junit4] 2> 446426 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica1 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:56616_m_%2Fbp
[junit4:junit4] 2> 446426 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica2 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:52357_m_%2Fbp
[junit4:junit4] 2> 446428 T1621 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_0_shard1_replica2
[junit4:junit4] 2> 446428 T1621 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 446428 T1637 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_0_shard1_replica1
[junit4:junit4] 2> 446429 T1637 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 446429 T1621 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 446429 T1637 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 446430 T1621 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 446430 T1637 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 446431 T1621 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 446431 T1637 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 446432 T1621 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 446432 T1637 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 446434 T1621 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 446434 T1637 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 446436 T1621 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_0_shard1_replica2/'
[junit4:junit4] 2> 446436 T1637 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_0_shard1_replica1/'
[junit4:junit4] 2> 446460 T1621 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 446481 T1637 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 446497 T1621 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 446498 T1621 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 446502 T1621 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica2] Schema name=test
[junit4:junit4] 2> 446534 T1637 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 446535 T1637 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 446540 T1637 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica1] Schema name=test
[junit4:junit4] 2> 446866 T1621 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 446871 T1621 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 446874 T1621 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 446892 T1621 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 446895 T1621 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 446898 T1621 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 446899 T1621 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 446899 T1621 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 446899 T1621 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 446900 T1621 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 446901 T1621 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 446901 T1621 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 446901 T1621 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_0_shard1_replica2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_0_shard1_replica2/data/
[junit4:junit4] 2> 446901 T1621 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4fb675
[junit4:junit4] 2> 446902 T1621 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 446902 T1621 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_0_shard1_replica2/data
[junit4:junit4] 2> 446903 T1621 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_0_shard1_replica2/data/index/
[junit4:junit4] 2> 446903 T1621 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard1_replica2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_0_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 446903 T1621 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_0_shard1_replica2/data/index
[junit4:junit4] 2> 446905 T1621 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6ff6fe07 lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a4f0c5),segFN=segments_1,generation=1}
[junit4:junit4] 2> 446905 T1621 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 446907 T1621 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 446907 T1621 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 446908 T1621 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 446908 T1621 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 446909 T1621 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 446909 T1621 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 446909 T1621 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 446910 T1621 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 446910 T1621 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 446912 T1621 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 446914 T1621 oass.SolrIndexSearcher.<init> Opening Searcher@52d93f52 main
[junit4:junit4] 2> 446914 T1621 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_0_shard1_replica2/data/tlog
[junit4:junit4] 2> 446915 T1621 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 446915 T1621 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 446918 T1659 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard1_replica2] Registered new searcher Searcher@52d93f52 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 446919 T1621 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica2 state=down
[junit4:junit4] 2> 446921 T1637 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 446926 T1637 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 446928 T1637 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 446939 T1637 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 446944 T1637 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 446947 T1637 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 446948 T1637 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 446948 T1637 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 446948 T1637 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 446949 T1637 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 446950 T1637 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 446950 T1637 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 446950 T1637 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_0_shard1_replica1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_0_shard1_replica1/data/
[junit4:junit4] 2> 446950 T1637 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4fb675
[junit4:junit4] 2> 446951 T1637 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 446951 T1637 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_0_shard1_replica1/data
[junit4:junit4] 2> 446952 T1637 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_0_shard1_replica1/data/index/
[junit4:junit4] 2> 446952 T1637 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard1_replica1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_0_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 446952 T1637 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_0_shard1_replica1/data/index
[junit4:junit4] 2> 446954 T1637 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@74a30fe1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7edc4c43),segFN=segments_1,generation=1}
[junit4:junit4] 2> 446954 T1637 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 446956 T1637 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 446956 T1637 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 446957 T1637 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 446957 T1637 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 446957 T1637 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 446958 T1637 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 446958 T1637 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 446958 T1637 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 446959 T1637 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 446961 T1637 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 446963 T1637 oass.SolrIndexSearcher.<init> Opening Searcher@23a23789 main
[junit4:junit4] 2> 446964 T1637 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_0_shard1_replica1/data/tlog
[junit4:junit4] 2> 446964 T1637 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 446965 T1637 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 446967 T1660 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard1_replica1] Registered new searcher Searcher@23a23789 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 446968 T1637 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica1 state=down
[junit4:junit4] 2> 447852 T1582 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 447853 T1582 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:46286_m_%2Fbp_nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:46286_m_%2Fbp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46286/m_/bp"}
[junit4:junit4] 2> 447858 T1582 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:56616_m_%2Fbp_nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56616_m_%2Fbp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56616/m_/bp"}
[junit4:junit4] 2> 447862 T1582 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52357_m_%2Fbp_nodes_used_collection_shard1_replica1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52357_m_%2Fbp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52357/m_/bp"}
[junit4:junit4] 2> 447865 T1582 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:44045_m_%2Fbp_nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:44045_m_%2Fbp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44045/m_/bp"}
[junit4:junit4] 2> 447870 T1582 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard1_replica2",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52357_m_%2Fbp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52357/m_/bp"}
[junit4:junit4] 2> 447870 T1582 oasc.Overseer$ClusterStateUpdater.createCollection Create collection awholynewcollection_0 with numShards 1
[junit4:junit4] 2> 447874 T1582 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard1_replica1",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56616_m_%2Fbp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56616/m_/bp"}
[junit4:junit4] 2> 447881 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 447882 T1641 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 447882 T1627 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 447882 T1599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 447881 T1581 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 447881 T1613 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 447881 T1586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 447881 T1658 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 447920 T1621 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard1_replica2
[junit4:junit4] 2> 447921 T1621 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard1_replica2 address:http://127.0.0.1:52357/m_/bp collection:awholynewcollection_0 shard:shard1
[junit4:junit4] 2> 447922 T1621 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leader_elect/shard1/election
[junit4:junit4] 2> 447932 T1621 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 447935 T1621 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=180000
[junit4:junit4] 2> 447970 T1637 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard1_replica1
[junit4:junit4] 2> 447970 T1637 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard1_replica1 address:http://127.0.0.1:56616/m_/bp collection:awholynewcollection_0 shard:shard1
[junit4:junit4] 2> 448357 T1607 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:46286_m_%2Fbp_nodes_used_collection_shard2_replica1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 448358 T1607 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:46286_m_%252Fbp_nodes_used_collection_shard2_replica1&state=recovering&nodeName=127.0.0.1:46286_m_%252Fbp&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard2_replica2&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2001
[junit4:junit4] 2> 448360 T1622 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:56616_m_%2Fbp_nodes_used_collection_shard1_replica2, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 448361 T1622 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:56616_m_%252Fbp_nodes_used_collection_shard1_replica2&state=recovering&nodeName=127.0.0.1:56616_m_%252Fbp&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard1_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2000
[junit4:junit4] 2> 448437 T1621 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 448437 T1621 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 448438 T1621 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52357/m_/bp/awholynewcollection_0_shard1_replica2/
[junit4:junit4] 2> 448438 T1621 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard1_replica2 url=http://127.0.0.1:52357/m_/bp START replicas=[http://127.0.0.1:56616/m_/bp/awholynewcollection_0_shard1_replica1/] nUpdates=100
[junit4:junit4] 2> 448438 T1621 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard1_replica2 url=http://127.0.0.1:52357/m_/bp DONE. We have no versions. sync failed.
[junit4:junit4] 2> 448439 T1621 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 448439 T1621 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 448439 T1621 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52357/m_/bp/awholynewcollection_0_shard1_replica2/
[junit4:junit4] 2> 448439 T1621 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leaders/shard1
[junit4:junit4] 2> ASYNC NEW_CORE C1302 name=awholynewcollection_0_shard1_replica1 org.apache.solr.core.SolrCore@7098fe06 url=http://127.0.0.1:56616/m_/bp/awholynewcollection_0_shard1_replica1 node=127.0.0.1:56616_m_%2Fbp C1302_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard1_replica1 props:{shard=shard1, state=down, core=awholynewcollection_0_shard1_replica1, collection=awholynewcollection_0, node_name=127.0.0.1:56616_m_%2Fbp, base_url=http://127.0.0.1:56616/m_/bp}
[junit4:junit4] 2> 448445 T1634 C1302 P56616 oasc.SolrCore.execute [awholynewcollection_0_shard1_replica1] webapp=/m_/bp path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 449400 T1582 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 449407 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 449408 T1613 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 449408 T1581 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 449408 T1641 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 449408 T1627 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 449407 T1586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 449407 T1658 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 449407 T1599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 449426 T1637 oasc.ZkController.register We are http://127.0.0.1:56616/m_/bp/awholynewcollection_0_shard1_replica1/ and leader is http://127.0.0.1:52357/m_/bp/awholynewcollection_0_shard1_replica2/
[junit4:junit4] 2> 449427 T1637 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard1_replica1 baseURL=http://127.0.0.1:56616/m_/bp
[junit4:junit4] 2> 449427 T1637 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard1_replica1
[junit4:junit4] 2> 449427 T1637 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> 449428 T1662 C1302 P56616 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard1_replica1 recoveringAfterStartup=true
[junit4:junit4] 2> 449428 T1662 C1302 P56616 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 449428 T1637 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 449429 T1662 C1302 P56616 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica1 state=recovering
[junit4:junit4] 2> 449430 T1637 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=1&shard=shard1&name=awholynewcollection_0_shard1_replica1&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=3002
[junit4:junit4] 2> 449430 T1662 C1302 P56616 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 449444 T1623 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:56616_m_%2Fbp_awholynewcollection_0_shard1_replica1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 449447 T1621 oasc.ZkController.register We are http://127.0.0.1:52357/m_/bp/awholynewcollection_0_shard1_replica2/ and leader is http://127.0.0.1:52357/m_/bp/awholynewcollection_0_shard1_replica2/
[junit4:junit4] 2> 449448 T1621 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard1_replica2 baseURL=http://127.0.0.1:52357/m_/bp
[junit4:junit4] 2> 449448 T1621 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 449448 T1621 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica2 state=active
[junit4:junit4] 2> 449451 T1621 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 449452 T1621 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=1&shard=shard1&name=awholynewcollection_0_shard1_replica2&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=3024
[junit4:junit4] 2> 449453 T1583 oasc.OverseerCollectionProcessor.createCollection Finished create command on all shards for collection: awholynewcollection_0
[junit4:junit4] 2> 449456 T1627 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work/qnr-0000000002 state: SyncConnected type NodeDataChanged
[junit4:junit4] 2> 449457 T1581 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 449457 T1583 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000002 complete, response:{success={null={responseHeader={status=0,QTime=3002},core=awholynewcollection_0_shard1_replica1},null={responseHeader={status=0,QTime=3024},core=awholynewcollection_0_shard1_replica2}}}
[junit4:junit4] 2> 449459 T1620 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={numShards=1&maxShardsPerNode=1&name=awholynewcollection_0&replicationFactor=2&action=CREATE&wt=javabin&version=2} status=0 QTime=3036
[junit4:junit4] 2> 449461 T1559 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 449462 T1559 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 449464 T1664 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@270f96 name:ZooKeeperConnection Watcher:127.0.0.1:34638/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 449464 T1559 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 449466 T1559 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 449472 T1621 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&maxShardsPerNode=2&name=awholynewcollection_1&replicationFactor=4&action=CREATE&wt=javabin&version=2
[junit4:junit4] 2> 449473 T1581 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 449474 T1583 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000004 message:{
[junit4:junit4] 2> "operation":"createcollection",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "maxShardsPerNode":"2",
[junit4:junit4] 2> "createNodeSet":null,
[junit4:junit4] 2> "name":"awholynewcollection_1",
[junit4:junit4] 2> "replicationFactor":"4"}
[junit4:junit4] 2> 449475 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard1_replica1 as part of slice shard1 of collection awholynewcollection_1 on 127.0.0.1:52357_m_%2Fbp
[junit4:junit4] 2> 449475 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard1_replica2 as part of slice shard1 of collection awholynewcollection_1 on 127.0.0.1:44045_m_%2Fbp
[junit4:junit4] 2> 449475 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard1_replica3 as part of slice shard1 of collection awholynewcollection_1 on 127.0.0.1:46286_m_%2Fbp
[junit4:junit4] 2> 449475 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard1_replica4 as part of slice shard1 of collection awholynewcollection_1 on 127.0.0.1:35380_m_%2Fbp
[junit4:junit4] 2> 449475 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard2_replica1 as part of slice shard2 of collection awholynewcollection_1 on 127.0.0.1:56616_m_%2Fbp
[junit4:junit4] 2> 449476 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard2_replica2 as part of slice shard2 of collection awholynewcollection_1 on 127.0.0.1:52357_m_%2Fbp
[junit4:junit4] 2> 449476 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard2_replica3 as part of slice shard2 of collection awholynewcollection_1 on 127.0.0.1:44045_m_%2Fbp
[junit4:junit4] 2> 449476 T1583 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard2_replica4 as part of slice shard2 of collection awholynewcollection_1 on 127.0.0.1:46286_m_%2Fbp
[junit4:junit4] 2> 449477 T1575 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard1_replica4' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/awholynewcollection_1_shard1_replica4
[junit4:junit4] 2> 449477 T1575 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4] 2> 449477 T1622 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard2_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_1_shard2_replica2
[junit4:junit4] 2> 449478 T1594 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard2_replica4' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/awholynewcollection_1_shard2_replica4
[junit4:junit4] 2> 449478 T1594 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4] 2> 449477 T1593 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard1_replica3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/awholynewcollection_1_shard1_replica3
[junit4:junit4] 2> 449479 T1593 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4] 2> 449477 T1620 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard1_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_1_shard1_replica1
[junit4:junit4] 2> 449479 T1594 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4] 2> 449479 T1634 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard2_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_1_shard2_replica1
[junit4:junit4] 2> 449478 T1607 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard2_replica3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/awholynewcollection_1_shard2_replica3
[junit4:junit4] 2> 449480 T1607 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4] 2> 449478 T1575 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4] 2> 449478 T1622 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4] 2> 449478 T1606 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard1_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/awholynewcollection_1_shard1_replica2
[junit4:junit4] 2> 449481 T1606 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4] 2> 449481 T1622 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4] 2> 449482 T1606 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4] 2> 449481 T1607 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4] 2> 449483 T1607 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 449481 T1575 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 449480 T1634 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4] 2> 449480 T1594 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 449479 T1593 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4] 2> 449479 T1620 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4] 2> 449488 T1593 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 449489 T1594 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 449484 T1575 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 449484 T1607 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 449484 T1634 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4] 2> 449490 T1593 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 449482 T1606 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 449482 T1622 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 449490 T1593 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4] 2> 449490 T1634 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 449490 T1607 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4] 2> 449489 T1575 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4] 2> 449489 T1594 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4] 2> 449489 T1620 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4] 2> 449493 T1634 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 449492 T1606 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 449493 T1634 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4] 2> 449493 T1620 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 449494 T1622 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 449494 T1606 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4] 2> 449494 T1622 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4] 2> 449495 T1593 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4] 2> 449496 T1575 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4] 2> 449496 T1620 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4] 2> 449496 T1594 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4] 2> 449496 T1607 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4] 2> 449497 T1593 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/awholynewcollection_1_shard1_replica3/'
[junit4:junit4] 2> 449498 T1606 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4] 2> 449498 T1634 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4] 2> 449500 T1575 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/awholynewcollection_1_shard1_replica4/'
[junit4:junit4] 2> 449501 T1594 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/awholynewcollection_1_shard2_replica4/'
[junit4:junit4] 2> 449503 T1622 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4] 2> 449504 T1620 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4] 2> 449504 T1607 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/awholynewcollection_1_shard2_replica3/'
[junit4:junit4] 2> 449505 T1634 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_1_shard2_replica1/'
[junit4:junit4] 2> 449506 T1606 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369404684537/awholynewcollection_1_shard1_replica2/'
[junit4:junit4] 2> 449513 T1622 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_1_shard2_replica2/'
[junit4:junit4] 2> 449513 T1620 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369404685705/awholynewcollection_1_shard1_replica1/'
[junit4:junit4] 2> 449535 T1593 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 449566 T1575 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 449598 T1634 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 449602 T1594 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 449621 T1622 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 449624 T1606 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 449625 T1620 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 449633 T1593 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 449635 T1593 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 449639 T1607 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 449650 T1593 oass.IndexSchema.readSchema [awholynewcollection_1_shard1_replica3] Schema name=test
[junit4:junit4] 2> 449679 T1634 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 449692 T1634 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 449694 T1575 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 449697 T1575 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 449697 T1594 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 449706 T1634 oass.IndexSchema.readSchema [awholynewcollection_1_shard2_replica1] Schema name=test
[junit4:junit4] 2> 449708 T1594 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 449711 T1575 oass.IndexSchema.readSchema [awholynewcollection_1_shard1_replica4] Schema name=test
[junit4:junit4] 2> 449715 T1594 oass.IndexSchema.readSchema [awholynewcollection_1_shard2_replica4] Schema name=test
[junit4:junit4] 2> 449718 T1606 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 449719 T1606 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 449736 T1606 oass.IndexSchema.readSchema [awholynewcollection_1_shard1_replica2] Schema name=test
[junit4:junit4] 2> 449742 T1620 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 449744 T1620 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 449745 T1622 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 449748 T1607 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 449751 T1620 oass.IndexSchema.readSchema [awholynewcollection_1_shard1_replica1] Schema name=test
[junit4:junit4] 2> 449752 T1607 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 449753 T1622 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 449768 T1607 oass.IndexSchema.readSchema [awholynewcollection_1_shard2_replica3] Schema name=test
[junit4:junit4] 2> 449769 T1622 oass.IndexSchema.readSchema [awholynewcollection_1_shard2_replica2] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C1303 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@24623f00 url=http://127.0.0.1:46286/m_/bp/nodes_used_collection_shard2_replica1 node=127.0.0.1:46286_m_%2Fbp C1303_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:46286_m_%2Fbp, base_url=http://127.0.0.1:46286/m_/bp}
[junit4:junit4] 2> 450360 T1653 C1303 P46286 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:44045/m_/bp/nodes_used_collection_shard2_replica2/ core=nodes_used_collection_shard2_replica1 - recoveringAfterStartup=true
[junit4:junit4] 2> 450360 T1653 C1303 P46286 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica1 url=http://127.0.0.1:46286/m_/bp START replicas=[http://127.0.0.1:44045/m_/bp/nodes_used_collection_shard2_replica2/] nUpdates=100
[junit4:junit4] 2> ASYNC NEW_CORE C1304 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@8a6f3de url=http://127.0.0.1:56616/m_/bp/nodes_used_collection_shard1_replica2 node=127.0.0.1:56616_m_%2Fbp C1304_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=recovering, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:56616_m_%2Fbp, base_url=http://127.0.0.1:56616/m_/bp}
[junit4:junit4] 2> 450361 T1654 C1304 P56616 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:52357/m_/bp/nodes_used_collection_shard1_replica1/ core=nodes_used_collection_shard1_replica2 - recoveringAfterStartup=true
[junit4:junit4] 2> 450362 T1654 C1304 P56616 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica2 url=http://127.0.0.1:56616/m_/bp START replicas=[http://127.0.0.1:52357/m_/bp/nodes_used_collection_shard1_replica1/] nUpdates=100
[junit4:junit4] 2> ASYNC NEW_CORE C1305 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@8a6f3de url=http://127.0.0.1:56616/m_/bp/nodes_used_collection_shard1_replica2 node=127.0.0.1:56616_m_%2Fbp C1305_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=recovering, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:56616_m_%2Fbp, base_url=http://127.0.0.1:56616/m_/bp}
[junit4:junit4] 2> 450370 T1654 C1305 P56616 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 450370 T1654 C1305 P56616 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 450370 T1654 C1305 P56616 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 450371 T1654 C1305 P56616 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 450371 T1654 C1305 P56616 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 450371 T1654 C1305 P56616 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:52357/m_/bp/nodes_used_collection_shard1_replica1/. core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 450371 T1654 C1305 P56616 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C1306 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@24623f00 url=http://127.0.0.1:46286/m_/bp/nodes_used_collection_shard2_replica1 node=127.0.0.1:46286_m_%2Fbp C1306_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:46286_m_%2Fbp, base_url=http://127.0.0.1:46286/m_/bp}
[junit4:junit4] 2> 450375 T1653 C1306 P46286 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 450375 T1653 C1306 P46286 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 450375 T1653 C1306 P46286 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 450375 T1653 C1306 P46286 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 450376 T1653 C1306 P46286 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 450376 T1653 C1306 P46286 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:44045/m_/bp/nodes_used_collection_shard2_replica2/. core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 450376 T1653 C1306 P46286 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C1307 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore@643397b6 url=http://127.0.0.1:52357/m_/bp/nodes_used_collection_shard1_replica1 node=127.0.0.1:52357_m_%2Fbp C1307_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{shard=shard1, state=active, core=nodes_used_collection_shard1_replica1, collection=nodes_used_collection, node_name=127.0.0.1:52357_m_%2Fbp, base_url=http://127.0.0.1:52357/m_/bp, leader=true}
[junit4:junit4] 2> 450382 T1670 C1307 P52357 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/m_/bp path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 450386 T1673 C1307 P52357 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C1308 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@35463c8f url=http://127.0.0.1:44045/m_/bp/nodes_used_collection_shard2_replica2 node=127.0.0.1:44045_m_%2Fbp C1308_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=active, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:44045_m_%2Fbp, base_url=http://127.0.0.1:44045/m_/bp, leader=true}
[junit4:junit4] 2> 450386 T1608 C1308 P44045 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 450392 T1608 C1308 P44045 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9754d51 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6d8220),segFN=segments_1,generation=1}
[junit4:junit4] 2> 450393 T1673 C1307 P52357 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@68f3ba82 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a23d642),segFN=segments_1,generation=1}
[junit4:junit4] 2> 450396 T1609 C1308 P44045 oasc.SolrCore.execute [nodes_used_collection_shard2_replica2] webapp=/m_/bp path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 450393 T1608 C1308 P44045 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> ASYNC NEW_CORE C1309 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore@643397b6 url=http://127.0.0.1:52357/m_/bp/nodes_used_collection_shard1_replica1 node=127.0.0.1:52357_m_%2Fbp C1309_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{shard=shard1, state=active, core=nodes_used_collection_shard1_replica1, collection=nodes_used_collection, node_name=127.0.0.1:52357_m_%2Fbp, base_url=http://127.0.0.1:52357/m_/bp, leader=true}
[junit4:junit4] 2> 450400 T1673 C1309 P52357 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> ASYNC NEW_CORE C1310 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@35463c8f url=http://127.0.0.1:44045/m_/bp/nodes_used_collection_shard2_replica2 node=127.0.0.1:44045_m_%2Fbp C1310_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=active, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:44045_m_%2Fbp, base_url=http://127.0.0.1:44045/m_/bp, leader=true}
[junit4:junit4] 2> 450404 T1608 C1310 P44045 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9754d51 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6d8220),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9754d51 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6d8220),segFN=segments_2,generation=2}
[junit4:junit4] 2> 450414 T1608 C1310 P44045 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 450414 T1673 C1309 P52357 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@68f3ba82 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a23d642),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@68f3ba82 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a23d642),segFN=segments_2,generation=2}
[junit4:junit4] 2> 450415 T1673 C1309 P52357 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 450415 T1608 C1310 P44045 oass.SolrIndexSearcher.<init> Opening Searcher@4ca09394 realtime
[junit4:junit4] 2> 450416 T1608 C1310 P44045 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 450416 T1608 C1310 P44045 oasup.LogUpdateProcessor.finish [nodes_used_collection_shard2_replica2] webapp=/m_/bp path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 30
[junit4:junit4] 2> 450417 T1673 C1309 P52357 oass.SolrIndexSearcher.<init> Opening Searcher@2c66c886 realtime
[junit4:junit4] 2> ASYNC NEW_CORE C1311 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@24623f00 url=http://127.0.0.1:46286/m_/bp/nodes_used_collection_shard2_replica1 node=127.0.0.1:46286_m_%2Fbp C1311_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:46286_m_%2Fbp, base_url=http://127.0.0.1:46286/m_/bp}
[junit4:junit4] 2> 450417 T1653 C1311 P46286 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 450418 T1673 C1309 P52357 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 450418 T1653 C1311 P46286 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 450418 T1673 C1309 P52357 oasup.LogUpdateProcessor.finish [nodes_used_collection_shard1_replica1] webapp=/m_/bp path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 32
[junit4:junit4] 2> ASYNC NEW_CORE C1312 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@8a6f3de url=http://127.0.0.1:56616/m_/bp/nodes_used_collection_shard1_replica2 node=127.0.0.1:56616_m_%2Fbp C1312_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=recovering, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:56616_m_%2Fbp, base_url=http://127.0.0.1:56616/m_/bp}
[junit4:junit4] 2> 450420 T1654 C1312 P56616 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 450420 T1654 C1312 P56616 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 450421 T1608 C1310 P44045 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 450421 T1608 C1310 P44045 oasc.SolrCore.execute [nodes_used_collection_shard2_replica2] webapp=/m_/bp path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 450422 T1653 C1311 P46286 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 450423 T1653 C1311 P46286 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 450423 T1653 C1311 P46286 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 450422 T1670 C1309 P52357 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 450423 T1670 C1309 P52357 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/m_/bp path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 450424 T1654 C1312 P56616 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 450425 T1654 C1312 P56616 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 450425 T1654 C1312 P56616 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 450426 T1609 C1310 P44045 oasc.SolrCore.execute [nodes_used_collection_shard2_replica2] webapp=/m_/bp path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 450427 T1653 C1311 P46286 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 450428 T1653 C1311 P46286 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data/index.20130524081134950
[junit4:junit4] 2> 450429 T1653 C1311 P46286 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@38d6dd85 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ffcd7d2) fullCopy=false
[junit4:junit4] 2> 450429 T1673 C1309 P52357 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/m_/bp path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 450429 T1654 C1312 P56616 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 450431 T1654 C1312 P56616 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data/index.20130524081134953
[junit4:junit4] 2> 450431 T1654 C1312 P56616 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@6ba0c287 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3dcb9b81) fullCopy=false
[junit4:junit4] 2> 450432 T1608 C1310 P44045 oasc.SolrCore.execute [nodes_used_collection_shard2_replica2] webapp=/m_/bp path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 450433 T1670 C1309 P52357 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/m_/bp path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C1313 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@8a6f3de url=http://127.0.0.1:56616/m_/bp/nodes_used_collection_shard1_replica2 node=127.0.0.1:56616_m_%2Fbp C1313_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=recovering, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:56616_m_%2Fbp, base_url=http://127.0.0.1:56616/m_/bp}
[junit4:junit4] 2> 450442 T1654 C1313 P56616 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> ASYNC NEW_CORE C1314 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@24623f00 url=http://127.0.0.1:46286/m_/bp/nodes_used_collection_shard2_replica1 node=127.0.0.1:46286_m_%2Fbp C1314_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:46286_m_%2Fbp, base_url=http://127.0.0.1:46286/m_/bp}
[junit4:junit4] 2> 450443 T1653 C1314 P46286 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 450444 T1654 C1313 P56616 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 450444 T1654 C1313 P56616 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 450446 T1654 C1313 P56616 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6f328d65 lockFactory=org.apache.lucene.store.NativeFSLockFactory@123118),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6f328d65 lockFactory=org.apache.lucene.store.NativeFSLockFactory@123118),segFN=segments_2,generation=2}
[junit4:junit4] 2> 450446 T1654 C1313 P56616 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 450447 T1654 C1313 P56616 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 450447 T1653 C1314 P46286 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 450448 T1654 C1313 P56616 oass.SolrIndexSearcher.<init> Opening Searcher@3403ecdf main
[junit4:junit4] 2> 450448 T1653 C1314 P46286 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 450449 T1650 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica2] Registered new searcher Searcher@3403ecdf main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 450449 T1653 C1314 P46286 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@74fe9f46 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3248e3cf),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@74fe9f46 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3248e3cf),segFN=segments_2,generation=2}
[junit4:junit4] 2> 450450 T1653 C1314 P46286 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 450450 T1653 C1314 P46286 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 450450 T1654 C1313 P56616 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data/index.20130524081134953 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data/index.20130524081134953;done=true>>]
[junit4:junit4] 2> 450450 T1653 C1314 P46286 oass.SolrIndexSearcher.<init> Opening Searcher@3003927d main
[junit4:junit4] 2> 450450 T1654 C1313 P56616 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data/index.20130524081134953
[junit4:junit4] 2> 450451 T1654 C1313 P56616 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/nodes_used_collection_shard1_replica2/data/index.20130524081134953
[junit4:junit4] 2> 450451 T1654 C1313 P56616 oasc.RecoveryStrategy.replay No replay needed. core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 450451 T1654 C1313 P56616 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 450451 T1648 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica1] Registered new searcher Searcher@3003927d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 450452 T1653 C1314 P46286 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data/index.20130524081134950 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data/index.20130524081134950;done=true>>]
[junit4:junit4] 2> 450452 T1653 C1314 P46286 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data/index.20130524081134950
[junit4:junit4] 2> 450453 T1653 C1314 P46286 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/nodes_used_collection_shard2_replica1/data/index.20130524081134950
[junit4:junit4] 2> 450453 T1653 C1314 P46286 oasc.RecoveryStrategy.replay No replay needed. core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 450453 T1653 C1314 P46286 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 450453 T1653 C1314 P46286 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=active
[junit4:junit4] 2> 450451 T1654 C1313 P56616 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=active
[junit4:junit4] 2> 450455 T1653 C1314 P46286 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 450457 T1654 C1313 P56616 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 450565 T1634 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 450580 T1634 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 450584 T1634 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 450603 T1575 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 450610 T1575 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 450614 T1593 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 450614 T1575 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 450617 T1634 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 450622 T1634 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 450632 T1593 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 450633 T1634 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 450634 T1634 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 450635 T1634 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 450635 T1634 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 450636 T1593 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 450641 T1634 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 450642 T1634 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 450643 T1634 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 450644 T1575 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 450644 T1634 oasc.SolrCore.<init> [awholynewcollection_1_shard2_replica1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_1_shard2_replica1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_1_shard2_replica1/data/
[junit4:junit4] 2> 450645 T1634 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4fb675
[junit4:junit4] 2> 450646 T1634 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 450647 T1634 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_1_shard2_replica1/data
[junit4:junit4] 2> 450647 T1634 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_1_shard2_replica1/data/index/
[junit4:junit4] 2> 450648 T1634 oasc.SolrCore.initIndex WARN [awholynewcollection_1_shard2_replica1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_1_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 450648 T1634 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369404686873/awholynewcollection_1_shard2_replica1/data/index
[junit4:junit4] 2> 450648 T1575 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 450654 T1575 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 450654 T1593 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 450657 T1575 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 450665 T1575 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 450665 T1575 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 450667 T1593 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 450668 T1634 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@755a6688 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5a687be5),segFN=segments_1,generation=1}
[junit4:junit4] 2> 450668 T1634 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 450667 T1575 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 450669 T1575 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 450670 T1575 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 450670 T1575 oasc.SolrCore.<init> [awholynewcollection_1_shard1_replica4] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/awholynewcollection_1_shard1_replica4/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/awholynewcollection_1_shard1_replica4/data/
[junit4:junit4] 2> 450671 T1575 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4fb675
[junit4:junit4] 2> 450671 T1575 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 450672 T1575 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/awholynewcollection_1_shard1_replica4/data
[junit4:junit4] 2> 450673 T1575 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/awholynewcollection_1_shard1_replica4/data/index/
[junit4:junit4] 2> 450673 T1575 oasc.SolrCore.initIndex WARN [awholynewcollection_1_shard1_replica4] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/awholynewcollection_1_shard1_replica4/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 450674 T1575 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369404683125/awholynewcollection_1_shard1_replica4/data/index
[junit4:junit4] 2> 450678 T1593 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 450678 T1634 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 450679 T1634 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 450679 T1593 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 450680 T1593 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 450680 T1593 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 450680 T1634 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 450681 T1634 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 450682 T1634 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 450682 T1634 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 450683 T1634 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 450684 T1634 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 450680 T1575 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@54f37d22 lockFactory=org.apache.lucene.store.NativeFSLockFactory@df66e80),segFN=segments_1,generation=1}
[junit4:junit4] 2> 450685 T1634 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 450682 T1593 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 450685 T1607 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 450685 T1575 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 450686 T1593 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 450687 T1593 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 450688 T1593 oasc.SolrCore.<init> [awholynewcollection_1_shard1_replica3] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/awholynewcollection_1_shard1_replica3/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/awholynewcollection_1_shard1_replica3/data/
[junit4:junit4] 2> 450688 T1593 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4fb675
[junit4:junit4] 2> 450688 T1634 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 450689 T1620 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 450689 T1575 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 450689 T1593 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 450700 T1575 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 450701 T1634 oass.SolrIndexSearcher.<init> Opening Searcher@35ed8feb main
[junit4:junit4] 2> 450701 T1593 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369404683333/awholynewcollection_1_shard1_replica3/data
[junit4:junit4] 2> 450701 T1634 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core
[...truncated too long message...]
4] 1> /solr/collections/awholynewcollection_2/leaders/shard2 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"awholynewcollection_2_shard2_replica3",
[junit4:junit4] 1> "node_name":"127.0.0.1:46286_m_%2Fbp",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:46286/m_/bp"}
[junit4:junit4] 1> /solr/collections/control_collection (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/control_collection/shards (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1 (2)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "configName":"conf1",
[junit4:junit4] 1> "router":"compositeId"}
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect (2)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard1/election (4)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard1/election/89745305292308483-127.0.0.1:35380_m_%2Fbp_awholynewcollection_1_shard1_replica4-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard1/election/89745305292308488-127.0.0.1:44045_m_%2Fbp_awholynewcollection_1_shard1_replica2-n_0000000003 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard1/election/89745305292308486-127.0.0.1:46286_m_%2Fbp_awholynewcollection_1_shard1_replica3-n_0000000001 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard1/election/89745305292308490-127.0.0.1:52357_m_%2Fbp_awholynewcollection_1_shard1_replica1-n_0000000002 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard2 (1)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard2/election (4)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard2/election/89745305292308486-127.0.0.1:46286_m_%2Fbp_awholynewcollection_1_shard2_replica4-n_0000000003 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard2/election/89745305292308488-127.0.0.1:44045_m_%2Fbp_awholynewcollection_1_shard2_replica3-n_0000000001 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard2/election/89745305292308490-127.0.0.1:52357_m_%2Fbp_awholynewcollection_1_shard2_replica2-n_0000000002 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard2/election/89745305292308492-127.0.0.1:56616_m_%2Fbp_awholynewcollection_1_shard2_replica1-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leaders (2)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"awholynewcollection_1_shard1_replica4",
[junit4:junit4] 1> "node_name":"127.0.0.1:35380_m_%2Fbp",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:35380/m_/bp"}
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leaders/shard2 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"awholynewcollection_1_shard2_replica1",
[junit4:junit4] 1> "node_name":"127.0.0.1:56616_m_%2Fbp",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:56616/m_/bp"}
[junit4:junit4] 1> /solr/overseer_elect (2)
[junit4:junit4] 1> /solr/overseer_elect/election (5)
[junit4:junit4] 1> /solr/overseer_elect/election/89745305292308492-127.0.0.1:56616_m_%2Fbp-n_0000000004 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89745305292308483-127.0.0.1:35380_m_%2Fbp-n_0000000000 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89745305292308490-127.0.0.1:52357_m_%2Fbp-n_0000000003 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89745305292308488-127.0.0.1:44045_m_%2Fbp-n_0000000002 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89745305292308486-127.0.0.1:46286_m_%2Fbp-n_0000000001 (0)
[junit4:junit4] 1> /solr/overseer_elect/leader (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"id":"89745305292308483-127.0.0.1:35380_m_%2Fbp-n_0000000000"}
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=5662BDE050A999FE -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_PR -Dtests.timezone=America/Chihuahua -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE 277s J1 | CollectionsAPIDistributedZkTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 230 seconds
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([5662BDE050A999FE:D78433F827F6F9C2]:0)
[junit4:junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:173)
[junit4:junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
[junit4:junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:126)
[junit4:junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:512)
[junit4:junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 715133 T1559 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 276862 T1558 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4] 2> 716349 T1641 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 716349 T1641 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 716349 T1641 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Appending, sim=DefaultSimilarity, locale=es_PR, timezone=America/Chihuahua
[junit4:junit4] 2> NOTE: Linux 3.2.0-41-generic amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=8,threads=1,free=98186600,total=224169984
[junit4:junit4] 2> NOTE: All tests run in this JVM: [PreAnalyzedUpdateProcessorTest, TestRandomFaceting, TestDefaultSimilarityFactory, TestLazyCores, SolrTestCaseJ4Test, TestCSVResponseWriter, TestHashPartitioner, TestPostingsSolrHighlighter, DirectSolrSpellCheckerTest, TestSystemIdResolver, UpdateParamsTest, SimplePostToolTest, SampleTest, TestDFRSimilarityFactory, TestIndexSearcher, TestSchemaNameResource, TestPropInject, TestCollationField, TestCodecSupport, SolrIndexConfigTest, JSONWriterTest, TestZkChroot, TestCSVLoader, ClusterStateTest, OutputWriterTest, HardAutoCommitTest, TestSchemaSimilarityResource, TestWordDelimiterFilterFactory, ZkSolrClientTest, TestSolrXml, TestNumberUtils, TermVectorComponentDistributedTest, PathHierarchyTokenizerFactoryTest, DistanceFunctionTest, TestJmxIntegration, CoreContainerCoreInitFailuresTest, TestJmxMonitoredMap, TestAnalyzedSuggestions, TestSolr4Spatial, IndexSchemaRuntimeFieldTest, TestSolrJ, OpenExchangeRatesOrgProviderTest, TestComponentsName, URLClassifyProcessorTest, FieldAnalysisRequestHandlerTest, ChaosMonkeySafeLeaderTest, TestDistributedGrouping, TestPartialUpdateDeduplication, TestBinaryResponseWriter, TestUpdate, TestUtils, IndexReaderFactoryTest, TestMultiCoreConfBootstrap, BadIndexSchemaTest, ZkNodePropsTest, TestReload, TestSolrQueryParserDefaultOperatorResource, TestRTGBase, TestSolrXMLSerializer, TestElisionMultitermQuery, RequestHandlersTest, TestUniqueKeyFieldResource, XsltUpdateRequestHandlerTest, TestLuceneMatchVersion, TestFieldTypeResource, SpellPossibilityIteratorTest, TestRecovery, TestRangeQuery, TestArbitraryIndexDir, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest]
[junit4:junit4] Completed on J1 in 278.14s, 1 test, 1 failure <<< FAILURES!
[...truncated 517 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:386: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:366: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:437: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1243: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 1 failure, 13 ignored (7 assumptions)
Total time: 41 minutes 13 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_21 -XX:-UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure