You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/06/14 04:33:12 UTC
[JENKINS] Lucene-Solr-4.x-Linux (32bit/ibm-j9-jdk6) - Build # 6055
- Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/6055/
Java: 32bit/ibm-j9-jdk6 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
1 tests failed.
REGRESSION: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
Server at http://127.0.0.1:55299/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:55299/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
at __randomizedtesting.SeedInfo.seed([7FBC5F4E10045FE1:FE5AD156675B3FDD]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:198)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:90)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:60)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
at java.lang.reflect.Method.invoke(Method.java:611)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:738)
Build Log:
[...truncated 8803 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4] 2> 471944 T833 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 471947 T833 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1371176076012
[junit4:junit4] 2> 471948 T833 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 471949 T834 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 472049 T833 oasc.ZkTestServer.run start zk server on port:59796
[junit4:junit4] 2> 472051 T833 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 472099 T840 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4cb34cb3 name:ZooKeeperConnection Watcher:127.0.0.1:59796 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 472100 T833 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 472100 T833 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 472108 T833 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 472114 T842 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3ced3ced name:ZooKeeperConnection Watcher:127.0.0.1:59796/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 472115 T833 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 472116 T833 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 472129 T833 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 472133 T833 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 472152 T833 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 472157 T833 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 472159 T833 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 472166 T833 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 472167 T833 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 472175 T833 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 472177 T833 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 472182 T833 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 472183 T833 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 472195 T833 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 472196 T833 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 472213 T833 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 472214 T833 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 472221 T833 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 472223 T833 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 472229 T833 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 472230 T833 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 472236 T833 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 472237 T833 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 472496 T833 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 472499 T833 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:46181
[junit4:junit4] 2> 472501 T833 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 472502 T833 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 472503 T833 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1371176076308
[junit4:junit4] 2> 472504 T833 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1371176076308/solr.xml
[junit4:junit4] 2> 472505 T833 oasc.CoreContainer.<init> New CoreContainer 1590648527
[junit4:junit4] 2> 472506 T833 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1371176076308/'
[junit4:junit4] 2> 472507 T833 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1371176076308/'
[junit4:junit4] 2> 472570 T833 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 472571 T833 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 472572 T833 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 472572 T833 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 472573 T833 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 472574 T833 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 472575 T833 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 472576 T833 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 472577 T833 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 472578 T833 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 472587 T833 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 472589 T833 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59796/solr
[junit4:junit4] 2> 472612 T833 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 472614 T833 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 472619 T853 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2840284 name:ZooKeeperConnection Watcher:127.0.0.1:59796 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 472620 T833 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 472626 T833 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 472635 T833 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 472640 T855 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@44b444b4 name:ZooKeeperConnection Watcher:127.0.0.1:59796/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 472640 T833 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 472643 T833 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 472650 T833 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 472657 T833 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 472660 T833 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46181_
[junit4:junit4] 2> 472662 T833 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46181_
[junit4:junit4] 2> 472669 T833 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 472684 T833 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 472691 T833 oasc.Overseer.start Overseer (id=89861395317784579-127.0.0.1:46181_-n_0000000000) starting
[junit4:junit4] 2> 472700 T833 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 472715 T857 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 472717 T833 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 472723 T833 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 472728 T833 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 472743 T856 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 472747 T858 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 472747 T858 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 474252 T856 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 474253 T856 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46181",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:46181_",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 474254 T856 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 474254 T856 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 474262 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 474750 T858 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1371176076308/collection1
[junit4:junit4] 2> 474751 T858 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 474752 T858 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 474753 T858 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 474791 T858 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1371176076308/collection1/'
[junit4:junit4] 2> 474792 T858 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1371176076308/collection1/lib/README' to classloader
[junit4:junit4] 2> 474794 T858 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1371176076308/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 474851 T858 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 474903 T858 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 474910 T858 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 474919 T858 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 475510 T858 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 475515 T858 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 475518 T858 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 475539 T858 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 475552 T858 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 475559 T858 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 475562 T858 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 475563 T858 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 475563 T858 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 475566 T858 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 475567 T858 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 475567 T858 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 475568 T858 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1371176076308/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/control/data/
[junit4:junit4] 2> 475570 T858 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@14101410
[junit4:junit4] 2> 475571 T858 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 475572 T858 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/control/data
[junit4:junit4] 2> 475573 T858 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/control/data/index/
[junit4:junit4] 2> 475574 T858 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 475574 T858 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/control/data/index
[junit4:junit4] 2> 475578 T858 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3b5a3b5a lockFactory=org.apache.lucene.store.NativeFSLockFactory@64416441),segFN=segments_1,generation=1}
[junit4:junit4] 2> 475578 T858 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 475582 T858 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 475583 T858 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 475584 T858 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 475585 T858 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 475586 T858 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 475586 T858 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 475587 T858 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 475588 T858 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 475589 T858 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 475591 T858 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 475594 T858 oass.SolrIndexSearcher.<init> Opening Searcher@63796379 main
[junit4:junit4] 2> 475594 T858 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/control/data/tlog
[junit4:junit4] 2> 475596 T858 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 475597 T858 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 475604 T859 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@63796379 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 475606 T858 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 475607 T858 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:46181 collection:control_collection shard:shard1
[junit4:junit4] 2> 475608 T858 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 475640 T858 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 475647 T858 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 475648 T858 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 475648 T858 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:46181/collection1/
[junit4:junit4] 2> 475666 T858 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 475667 T858 oasc.SyncStrategy.syncToMe http://127.0.0.1:46181/collection1/ has no replicas
[junit4:junit4] 2> 475667 T858 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:46181/collection1/
[junit4:junit4] 2> 475668 T858 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 475771 T856 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 475796 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 475831 T858 oasc.ZkController.register We are http://127.0.0.1:46181/collection1/ and leader is http://127.0.0.1:46181/collection1/
[junit4:junit4] 2> 475832 T858 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46181
[junit4:junit4] 2> 475832 T858 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 475833 T858 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 475834 T858 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 475837 T858 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 475839 T833 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 475840 T833 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 475842 T833 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 475850 T833 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 475852 T833 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 475864 T862 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@641a641a name:ZooKeeperConnection Watcher:127.0.0.1:59796/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 475865 T833 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 475868 T833 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 475873 T833 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 476132 T833 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 476135 T833 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:36437
[junit4:junit4] 2> 476136 T833 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 476136 T833 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 476137 T833 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1371176079938
[junit4:junit4] 2> 476138 T833 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1371176079938/solr.xml
[junit4:junit4] 2> 476139 T833 oasc.CoreContainer.<init> New CoreContainer 203492385
[junit4:junit4] 2> 476139 T833 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1371176079938/'
[junit4:junit4] 2> 476140 T833 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1371176079938/'
[junit4:junit4] 2> 476202 T833 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 476203 T833 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 476204 T833 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 476205 T833 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 476206 T833 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 476207 T833 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 476208 T833 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 476209 T833 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 476210 T833 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 476211 T833 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 476219 T833 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 476221 T833 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59796/solr
[junit4:junit4] 2> 476222 T833 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 476224 T833 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 476234 T873 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@286a286a name:ZooKeeperConnection Watcher:127.0.0.1:59796 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 476235 T833 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 476240 T833 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 476249 T833 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 476256 T875 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f107f1 name:ZooKeeperConnection Watcher:127.0.0.1:59796/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 476257 T833 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 476266 T833 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 477312 T856 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 477314 T856 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46181",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:46181__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:46181_",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 477318 T833 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36437_
[junit4:junit4] 2> 477321 T833 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36437_
[junit4:junit4] 2> 477324 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 477324 T862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 477325 T875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 477329 T862 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 477331 T875 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 477335 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 477340 T876 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 477341 T876 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 477343 T855 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 478835 T856 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 478837 T856 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36437",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:36437_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 478838 T856 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 478838 T856 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 478848 T862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 478848 T875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 478848 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 479349 T876 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1371176079938/collection1
[junit4:junit4] 2> 479350 T876 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 479352 T876 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 479353 T876 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 479356 T876 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1371176079938/collection1/'
[junit4:junit4] 2> 479358 T876 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1371176079938/collection1/lib/README' to classloader
[junit4:junit4] 2> 479360 T876 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1371176079938/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 479435 T876 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 479480 T876 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 479483 T876 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 479495 T876 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 480179 T876 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 480186 T876 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 480190 T876 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 480252 T876 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 480259 T876 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 480267 T876 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 480270 T876 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 480271 T876 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 480283 T876 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 480286 T876 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 480286 T876 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 480287 T876 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 480287 T876 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1371176079938/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty1/
[junit4:junit4] 2> 480288 T876 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@14101410
[junit4:junit4] 2> 480289 T876 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 480291 T876 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty1
[junit4:junit4] 2> 480292 T876 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty1/index/
[junit4:junit4] 2> 480292 T876 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 480293 T876 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty1/index
[junit4:junit4] 2> 480295 T876 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3a8c3a8c lockFactory=org.apache.lucene.store.NativeFSLockFactory@23da23da),segFN=segments_1,generation=1}
[junit4:junit4] 2> 480296 T876 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 480299 T876 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 480300 T876 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 480300 T876 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 480301 T876 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 480302 T876 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 480302 T876 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 480303 T876 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 480304 T876 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 480305 T876 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 480307 T876 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 480310 T876 oass.SolrIndexSearcher.<init> Opening Searcher@49474947 main
[junit4:junit4] 2> 480311 T876 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty1/tlog
[junit4:junit4] 2> 480312 T876 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 480313 T876 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 480324 T877 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@49474947 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 480329 T876 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 480330 T876 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36437 collection:collection1 shard:shard1
[junit4:junit4] 2> 480337 T876 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 480360 T876 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 480364 T876 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 480365 T876 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 480366 T876 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36437/collection1/
[junit4:junit4] 2> 480366 T876 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 480367 T876 oasc.SyncStrategy.syncToMe http://127.0.0.1:36437/collection1/ has no replicas
[junit4:junit4] 2> 480368 T876 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36437/collection1/
[junit4:junit4] 2> 480368 T876 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 481864 T856 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 481922 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 481923 T875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 481924 T862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 481955 T876 oasc.ZkController.register We are http://127.0.0.1:36437/collection1/ and leader is http://127.0.0.1:36437/collection1/
[junit4:junit4] 2> 481956 T876 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36437
[junit4:junit4] 2> 481957 T876 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 481957 T876 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 481958 T876 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 481961 T876 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 481963 T833 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 481964 T833 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 481965 T833 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 482183 T833 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 482186 T833 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55299
[junit4:junit4] 2> 482187 T833 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 482188 T833 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 482189 T833 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1371176086039
[junit4:junit4] 2> 482190 T833 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1371176086039/solr.xml
[junit4:junit4] 2> 482190 T833 oasc.CoreContainer.<init> New CoreContainer 1378767406
[junit4:junit4] 2> 482191 T833 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1371176086039/'
[junit4:junit4] 2> 482192 T833 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1371176086039/'
[junit4:junit4] 2> 482276 T833 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 482277 T833 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 482278 T833 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 482279 T833 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 482280 T833 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 482281 T833 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 482282 T833 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 482283 T833 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 482284 T833 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 482285 T833 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 482294 T833 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 482297 T833 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59796/solr
[junit4:junit4] 2> 482298 T833 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 482299 T833 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 482302 T889 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4e664e66 name:ZooKeeperConnection Watcher:127.0.0.1:59796 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 482303 T833 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 482308 T833 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 482318 T833 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 482321 T891 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@770c770c name:ZooKeeperConnection Watcher:127.0.0.1:59796/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 482322 T833 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 482335 T833 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 483343 T833 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55299_
[junit4:junit4] 2> 483346 T833 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55299_
[junit4:junit4] 2> 483350 T862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 483350 T875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 483352 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 483354 T862 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 483355 T891 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 483402 T875 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 483405 T855 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 483411 T892 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 483411 T892 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 483439 T856 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 483440 T856 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36437",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:36437__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:36437_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 483447 T856 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55299",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:55299_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 483447 T856 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 483448 T856 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 483455 T862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 483455 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 483455 T875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 483460 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 484413 T892 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1371176086039/collection1
[junit4:junit4] 2> 484414 T892 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 484416 T892 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 484416 T892 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 484419 T892 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1371176086039/collection1/'
[junit4:junit4] 2> 484421 T892 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1371176086039/collection1/lib/README' to classloader
[junit4:junit4] 2> 484422 T892 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1371176086039/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 484490 T892 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 484535 T892 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 484552 T892 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 484560 T892 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 485092 T892 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 485099 T892 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 485119 T892 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 485156 T892 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 485167 T892 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 485176 T892 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 485182 T892 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 485183 T892 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 485183 T892 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 485187 T892 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 485188 T892 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 485189 T892 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 485190 T892 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1371176086039/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty2/
[junit4:junit4] 2> 485190 T892 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@14101410
[junit4:junit4] 2> 485192 T892 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 485193 T892 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty2
[junit4:junit4] 2> 485194 T892 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty2/index/
[junit4:junit4] 2> 485195 T892 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 485196 T892 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty2/index
[junit4:junit4] 2> 485199 T892 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@31403140 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f345f34),segFN=segments_1,generation=1}
[junit4:junit4] 2> 485200 T892 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 485205 T892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 485206 T892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 485207 T892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 485208 T892 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 485209 T892 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 485210 T892 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 485211 T892 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 485212 T892 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 485213 T892 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 485215 T892 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 485218 T892 oass.SolrIndexSearcher.<init> Opening Searcher@1ff91ff9 main
[junit4:junit4] 2> 485218 T892 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty2/tlog
[junit4:junit4] 2> 485220 T892 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 485221 T892 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 485232 T892 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 485233 T892 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55299 collection:collection1 shard:shard2
[junit4:junit4] 2> 485235 T893 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ff91ff9 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 485239 T892 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 485283 T892 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 485287 T892 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 485288 T892 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 485288 T892 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55299/collection1/
[junit4:junit4] 2> 485289 T892 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 485289 T892 oasc.SyncStrategy.syncToMe http://127.0.0.1:55299/collection1/ has no replicas
[junit4:junit4] 2> 485290 T892 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55299/collection1/
[junit4:junit4] 2> 485290 T892 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 486497 T856 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 486518 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 486518 T862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 486518 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 486518 T875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 486555 T892 oasc.ZkController.register We are http://127.0.0.1:55299/collection1/ and leader is http://127.0.0.1:55299/collection1/
[junit4:junit4] 2> 486555 T892 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55299
[junit4:junit4] 2> 486556 T892 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 486557 T892 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 486557 T892 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 486561 T892 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 486563 T833 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 486564 T833 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 486565 T833 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 486821 T833 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 486823 T833 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:34599
[junit4:junit4] 2> 486824 T833 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 486825 T833 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 486826 T833 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1371176090639
[junit4:junit4] 2> 486826 T833 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1371176090639/solr.xml
[junit4:junit4] 2> 486827 T833 oasc.CoreContainer.<init> New CoreContainer 801845195
[junit4:junit4] 2> 486828 T833 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1371176090639/'
[junit4:junit4] 2> 486829 T833 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1371176090639/'
[junit4:junit4] 2> 486914 T833 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 486915 T833 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 486916 T833 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 486917 T833 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 486918 T833 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 486919 T833 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 486920 T833 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 486920 T833 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 486921 T833 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 486922 T833 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 486930 T833 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 486932 T833 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59796/solr
[junit4:junit4] 2> 486933 T833 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 486935 T833 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 486944 T905 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48a348a3 name:ZooKeeperConnection Watcher:127.0.0.1:59796 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 486945 T833 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 486950 T833 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 486960 T833 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 486966 T907 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@523b523b name:ZooKeeperConnection Watcher:127.0.0.1:59796/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 486969 T833 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 486996 T833 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 488004 T833 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34599_
[junit4:junit4] 2> 488006 T833 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34599_
[junit4:junit4] 2> 488010 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 488010 T875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 488010 T862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 488012 T891 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 488025 T907 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 488026 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 488030 T855 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 488032 T862 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 488033 T875 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 488040 T908 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 488040 T908 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 488043 T856 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 488044 T856 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55299",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:55299__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:55299_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 488057 T856 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34599",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:34599_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 488057 T856 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 488058 T856 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 488066 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 488066 T875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 488066 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 488066 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 488066 T862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 489044 T908 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1371176090639/collection1
[junit4:junit4] 2> 489044 T908 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 489046 T908 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 489047 T908 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 489050 T908 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1371176090639/collection1/'
[junit4:junit4] 2> 489053 T908 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1371176090639/collection1/lib/README' to classloader
[junit4:junit4] 2> 489054 T908 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1371176090639/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 489174 T908 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 489228 T908 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 489233 T908 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 489240 T908 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 489875 T908 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 489882 T908 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 489886 T908 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 489933 T908 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 489941 T908 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 489948 T908 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 489951 T908 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 489951 T908 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 489952 T908 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 489955 T908 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 489956 T908 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 489956 T908 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 489957 T908 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1371176090639/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty3/
[junit4:junit4] 2> 489958 T908 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@14101410
[junit4:junit4] 2> 489959 T908 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 489960 T908 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty3
[junit4:junit4] 2> 489961 T908 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty3/index/
[junit4:junit4] 2> 489962 T908 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 489962 T908 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty3/index
[junit4:junit4] 2> 489966 T908 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@250a250a lockFactory=org.apache.lucene.store.NativeFSLockFactory@59195919),segFN=segments_1,generation=1}
[junit4:junit4] 2> 489966 T908 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 489971 T908 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 489972 T908 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 489973 T908 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 489974 T908 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 489975 T908 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 489976 T908 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 489977 T908 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 489978 T908 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 489979 T908 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 489982 T908 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 489985 T908 oass.SolrIndexSearcher.<init> Opening Searcher@79987998 main
[junit4:junit4] 2> 489985 T908 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty3/tlog
[junit4:junit4] 2> 489987 T908 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 489988 T908 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 489996 T909 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@79987998 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 490002 T908 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 490003 T908 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:34599 collection:collection1 shard:shard1
[junit4:junit4] 2> 490009 T908 oasc.ZkController.register We are http://127.0.0.1:34599/collection1/ and leader is http://127.0.0.1:36437/collection1/
[junit4:junit4] 2> 490009 T908 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34599
[junit4:junit4] 2> 490010 T908 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 490011 T908 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C8533 name=collection1 org.apache.solr.core.SolrCore@3dc93dc9 url=http://127.0.0.1:34599/collection1 node=127.0.0.1:34599_ C8533_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:34599, state=down, node_name=127.0.0.1:34599_, collection=collection1, core=collection1}
[junit4:junit4] 2> 490012 T910 C8533 P34599 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 490012 T910 C8533 P34599 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 490013 T908 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 490014 T910 C8533 P34599 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 490022 T910 C8533 P34599 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 490025 T833 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 490025 T910 C8533 P34599 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 490026 T833 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 490028 T833 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 490069 T868 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:34599__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 490246 T833 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 490249 T833 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54293
[junit4:junit4] 2> 490250 T833 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 490251 T833 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 490252 T833 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1371176094118
[junit4:junit4] 2> 490253 T833 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1371176094118/solr.xml
[junit4:junit4] 2> 490254 T833 oasc.CoreContainer.<init> New CoreContainer 1349537904
[junit4:junit4] 2> 490255 T833 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1371176094118/'
[junit4:junit4] 2> 490256 T833 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1371176094118/'
[junit4:junit4] 2> 490355 T833 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 490357 T833 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 490359 T833 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 490360 T833 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 490361 T833 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 490362 T833 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 490363 T833 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 490364 T833 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 490365 T833 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 490366 T833 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 490377 T833 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 490379 T833 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59796/solr
[junit4:junit4] 2> 490381 T833 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 490383 T833 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 490388 T922 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d740d74 name:ZooKeeperConnection Watcher:127.0.0.1:59796 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 490389 T833 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 490392 T833 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 490411 T833 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 490418 T924 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@631f631f name:ZooKeeperConnection Watcher:127.0.0.1:59796/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 490419 T833 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 490431 T833 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 491122 T856 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 491124 T856 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34599",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:34599__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:34599_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 491133 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 491134 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 491134 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 491134 T862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 491133 T875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 491134 T924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 491440 T833 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54293_
[junit4:junit4] 2> 491443 T833 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54293_
[junit4:junit4] 2> 491448 T862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 491448 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 491448 T875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 491450 T891 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 491448 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 491451 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 491454 T875 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 491454 T907 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 491456 T855 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 491458 T862 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 491459 T924 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 491460 T924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 491474 T925 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 491481 T925 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 492070 T868 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:34599__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 492071 T868 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={state=recovering&onlyIfLeader=true&checkLive=true&action=PREPRECOVERY&version=2&coreNodeName=127.0.0.1:34599__collection1&wt=javabin&nodeName=127.0.0.1:34599_&core=collection1} status=0 QTime=2008
[junit4:junit4] 2> 492651 T856 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 492653 T856 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:54293",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:54293_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 492654 T856 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 492654 T856 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 492661 T862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 492662 T875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 492662 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 492662 T924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 492662 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 492662 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 493488 T925 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1371176094118/collection1
[junit4:junit4] 2> 493488 T925 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 493490 T925 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 493490 T925 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 493494 T925 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1371176094118/collection1/'
[junit4:junit4] 2> 493496 T925 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1371176094118/collection1/lib/README' to classloader
[junit4:junit4] 2> 493496 T925 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1371176094118/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 493623 T925 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 493675 T925 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 493682 T925 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 493691 T925 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C8534 name=collection1 org.apache.solr.core.SolrCore@3dc93dc9 url=http://127.0.0.1:34599/collection1 node=127.0.0.1:34599_ C8534_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:34599, state=recovering, node_name=127.0.0.1:34599_, collection=collection1, shard=shard1, core=collection1}
[junit4:junit4] 2> 494073 T910 C8534 P34599 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:36437/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 494074 T910 C8534 P34599 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:34599 START replicas=[http://127.0.0.1:36437/collection1/] nUpdates=100
[junit4:junit4] 2> 494074 T910 C8534 P34599 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 494075 T910 C8534 P34599 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 494075 T910 C8534 P34599 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 494076 T910 C8534 P34599 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 494076 T910 C8534 P34599 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 494077 T910 C8534 P34599 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:36437/collection1/. core=collection1
[junit4:junit4] 2> 494077 T910 C8534 P34599 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C8535 name=collection1 org.apache.solr.core.SolrCore@b2d0b2d url=http://127.0.0.1:36437/collection1 node=127.0.0.1:36437_ C8535_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:36437, state=active, node_name=127.0.0.1:36437_, collection=collection1, shard=shard1, core=collection1, leader=true}
[junit4:junit4] 2> 494091 T870 C8535 P36437 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&qt=/get&distrib=false&version=2&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C8536 name=collection1 org.apache.solr.core.SolrCore@b2d0b2d url=http://127.0.0.1:36437/collection1 node=127.0.0.1:36437_ C8536_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:36437, state=active, node_name=127.0.0.1:36437_, collection=collection1, shard=shard1, core=collection1, leader=true}
[junit4:junit4] 2> 494092 T871 C8536 P36437 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 494112 T871 C8536 P36437 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3a8c3a8c lockFactory=org.apache.lucene.store.NativeFSLockFactory@23da23da),segFN=segments_1,generation=1}
[junit4:junit4] 2> 494113 T871 C8536 P36437 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 494115 T871 C8536 P36437 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3a8c3a8c lockFactory=org.apache.lucene.store.NativeFSLockFactory@23da23da),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3a8c3a8c lockFactory=org.apache.lucene.store.NativeFSLockFactory@23da23da),segFN=segments_2,generation=2}
[junit4:junit4] 2> 494116 T871 C8536 P36437 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 494117 T871 C8536 P36437 oass.SolrIndexSearcher.<init> Opening Searcher@4cb84cb8 realtime
[junit4:junit4] 2> 494118 T871 C8536 P36437 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 494119 T871 C8536 P36437 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={softCommit=false&commit_end_point=true&commit=true&version=2&waitSearcher=true&wt=javabin&openSearcher=false} {commit=} 0 27
[junit4:junit4] 2> ASYNC NEW_CORE C8537 name=collection1 org.apache.solr.core.SolrCore@3dc93dc9 url=http://127.0.0.1:34599/collection1 node=127.0.0.1:34599_ C8537_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:34599, state=recovering, node_name=127.0.0.1:34599_, collection=collection1, shard=shard1, core=collection1}
[junit4:junit4] 2> 494120 T910 C8537 P34599 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 494121 T910 C8537 P34599 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 494124 T870 C8536 P36437 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 494125 T870 C8536 P36437 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&version=2&command=indexversion&wt=javabin} status=0 QTime=2
[junit4:junit4] 2> 494126 T910 C8537 P34599 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 494127 T910 C8537 P34599 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 494127 T910 C8537 P34599 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 494130 T869 C8536 P36437 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&version=2&generation=2&command=filelist&wt=javabin} status=0 QTime=1
[junit4:junit4] 2> 494131 T910 C8537 P34599 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 494132 T910 C8537 P34599 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty3/index.20130614151458196
[junit4:junit4] 2> 494133 T910 C8537 P34599 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@2d802d8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@466c466c) fullCopy=false
[junit4:junit4] 2> 494135 T868 C8536 P36437 oasc.SolrCore.execute [collection1] webapp= path=/replication params={checksum=true&qt=/replication&generation=2&command=filecontent&file=segments_2&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 494137 T910 C8537 P34599 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 494143 T910 C8537 P34599 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 494144 T910 C8537 P34599 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 494145 T910 C8537 P34599 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@250a250a lockFactory=org.apache.lucene.store.NativeFSLockFactory@59195919),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@250a250a lockFactory=org.apache.lucene.store.NativeFSLockFactory@59195919),segFN=segments_2,generation=2}
[junit4:junit4] 2> 494146 T910 C8537 P34599 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 494147 T910 C8537 P34599 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 494148 T910 C8537 P34599 oass.SolrIndexSearcher.<init> Opening Searcher@55995599 main
[junit4:junit4] 2> 494150 T909 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@55995599 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 494155 T910 C8537 P34599 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty3/index.20130614151458196 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty3/index.20130614151458196;done=true>>]
[junit4:junit4] 2> 494156 T910 C8537 P34599 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty3/index.20130614151458196
[junit4:junit4] 2> 494157 T910 C8537 P34599 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty3/index.20130614151458196
[junit4:junit4] 2> 494158 T910 C8537 P34599 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 494158 T910 C8537 P34599 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 494159 T910 C8537 P34599 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 494159 T910 C8537 P34599 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 494165 T910 C8537 P34599 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 494176 T856 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 494178 T856 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34599",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:34599__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:34599_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 494186 T924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 494186 T862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 494187 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 494187 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 494215 T875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 494187 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 494389 T925 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 494397 T925 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 494400 T925 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 494436 T925 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 494444 T925 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 494451 T925 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 494454 T925 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 494455 T925 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 494456 T925 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 494458 T925 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 494459 T925 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 494460 T925 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 494460 T925 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1371176094118/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty4/
[junit4:junit4] 2> 494461 T925 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@14101410
[junit4:junit4] 2> 494462 T925 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 494463 T925 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty4
[junit4:junit4] 2> 494463 T925 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty4/index/
[junit4:junit4] 2> 494464 T925 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 494465 T925 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty4/index
[junit4:junit4] 2> 494467 T925 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@639a639a lockFactory=org.apache.lucene.store.NativeFSLockFactory@786e786e),segFN=segments_1,generation=1}
[junit4:junit4] 2> 494468 T925 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 494472 T925 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 494472 T925 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 494473 T925 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 494474 T925 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 494475 T925 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 494476 T925 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 494486 T925 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 494487 T925 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 494488 T925 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 494489 T925 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 494492 T925 oass.SolrIndexSearcher.<init> Opening Searcher@73d673d6 main
[junit4:junit4] 2> 494493 T925 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty4/tlog
[junit4:junit4] 2> 494494 T925 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 494495 T925 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 494503 T928 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@73d673d6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 494531 T925 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 494532 T925 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54293 collection:collection1 shard:shard2
[junit4:junit4] 2> 494546 T925 oasc.ZkController.register We are http://127.0.0.1:54293/collection1/ and leader is http://127.0.0.1:55299/collection1/
[junit4:junit4] 2> 494547 T925 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54293
[junit4:junit4] 2> 494547 T925 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 494548 T925 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C8538 name=collection1 org.apache.solr.core.SolrCore@4e464e46 url=http://127.0.0.1:54293/collection1 node=127.0.0.1:54293_ C8538_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:54293, state=down, node_name=127.0.0.1:54293_, collection=collection1, core=collection1}
[junit4:junit4] 2> 494550 T929 C8538 P54293 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 494550 T925 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 494551 T929 C8538 P54293 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 494554 T833 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 494558 T833 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 494559 T833 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 494557 T929 C8538 P54293 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 494561 T929 C8538 P54293 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 494568 T929 C8538 P54293 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 494570 T833 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 494572 T833 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 494581 T887 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:54293__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 494582 T868 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 495727 T856 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 495728 T856 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:54293",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:54293__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:54293_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 495739 T856 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36437",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:36437_",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"onenodecollectioncore"}
[junit4:junit4] 2> 495739 T856 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4] 2> 495740 T856 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 495748 T924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 495749 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 495749 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 495750 T875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 495749 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 495749 T862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 496584 T868 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1371176079938/onenodecollectioncore
[junit4:junit4] 2> 496585 T868 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4] 2> 496585 T887 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:54293__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 496587 T868 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4] 2> 496588 T887 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={state=recovering&onlyIfLeader=true&checkLive=true&action=PREPRECOVERY&version=2&coreNodeName=127.0.0.1:54293__collection1&wt=javabin&nodeName=127.0.0.1:54293_&core=collection1} status=0 QTime=2007
[junit4:junit4] 2> 496589 T868 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 496593 T868 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 496594 T868 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4] 2> 496600 T868 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4] 2> 496603 T868 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1371176079938/onenodecollectioncore/'
[junit4:junit4] 2> 496665 T868 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 496719 T868 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 496727 T868 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 496736 T868 oass.IndexSchema.readSchema [onenodecollectioncore] Schema name=test
[junit4:junit4] 2> 497377 T868 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 497410 T868 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 497415 T868 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 497439 T868 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 497445 T868 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 497450 T868 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 497453 T868 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 497455 T868 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 497456 T868 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 497461 T868 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 497463 T868 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 497464 T868 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 497465 T868 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1371176079938/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1371176076012/onenodecollection/
[junit4:junit4] 2> 497466 T868 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@14101410
[junit4:junit4] 2> 497468 T868 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 497469 T868 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1371176076012/onenodecollection
[junit4:junit4] 2> 497470 T868 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1371176076012/onenodecollection/index/
[junit4:junit4] 2> 497471 T868 oasc.SolrCore.initIndex WARN [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1371176076012/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 497472 T868 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1371176076012/onenodecollection/index
[junit4:junit4] 2> 497476 T868 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@68d668d6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3ea23ea2),segFN=segments_1,generation=1}
[junit4:junit4] 2> 497477 T868 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 497481 T868 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 497482 T868 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 497484 T868 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 497485 T868 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 497487 T868 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 497488 T868 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 497489 T868 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 497491 T868 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 497492 T868 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 497495 T868 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 497498 T868 oass.SolrIndexSearcher.<init> Opening Searcher@421f421f main
[junit4:junit4] 2> 497500 T868 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1371176076012/onenodecollection/tlog
[junit4:junit4] 2> 497501 T868 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 497502 T868 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 497510 T931 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@421f421f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 497516 T868 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4] 2> 497518 T868 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:36437 collection:onenodecollection shard:shard1
[junit4:junit4] 2> 497520 T868 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4] 2> 497573 T868 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 497580 T868 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 497581 T868 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 497582 T868 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36437/onenodecollectioncore/
[junit4:junit4] 2> 497583 T868 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 497585 T868 oasc.SyncStrategy.syncToMe http://127.0.0.1:36437/onenodecollectioncore/ has no replicas
[junit4:junit4] 2> 497586 T868 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36437/onenodecollectioncore/
[junit4:junit4] 2> 497587 T868 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4] 2> ASYNC NEW_CORE C8539 name=collection1 org.apache.solr.core.SolrCore@4e464e46 url=http://127.0.0.1:54293/collection1 node=127.0.0.1:54293_ C8539_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:54293, state=recovering, node_name=127.0.0.1:54293_, collection=collection1, shard=shard2, core=collection1}
[junit4:junit4] 2> 498590 T929 C8539 P54293 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:55299/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 498591 T929 C8539 P54293 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:54293 START replicas=[http://127.0.0.1:55299/collection1/] nUpdates=100
[junit4:junit4] 2> 498592 T929 C8539 P54293 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 498592 T929 C8539 P54293 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 498593 T929 C8539 P54293 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 498594 T929 C8539 P54293 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 498594 T929 C8539 P54293 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 498595 T929 C8539 P54293 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:55299/collection1/. core=collection1
[junit4:junit4] 2> 498595 T929 C8539 P54293 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C8540 name=collection1 org.apache.solr.core.SolrCore@41494149 url=http://127.0.0.1:55299/collection1 node=127.0.0.1:55299_ C8540_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:55299, state=active, node_name=127.0.0.1:55299_, collection=collection1, shard=shard2, core=collection1, leader=true}
[junit4:junit4] 2> 498602 T887 C8540 P55299 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&qt=/get&distrib=false&version=2&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> 498607 T885 C8540 P55299 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 498610 T885 C8540 P55299 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@31403140 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f345f34),segFN=segments_1,generation=1}
[junit4:junit4] 2> 498611 T885 C8540 P55299 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 498613 T885 C8540 P55299 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@31403140 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f345f34),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@31403140 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f345f34),segFN=segments_2,generation=2}
[junit4:junit4] 2> 498614 T885 C8540 P55299 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 498615 T885 C8540 P55299 oass.SolrIndexSearcher.<init> Opening Searcher@29392939 realtime
[junit4:junit4] 2> 498616 T885 C8540 P55299 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 498617 T885 C8540 P55299 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={softCommit=false&commit_end_point=true&commit=true&version=2&waitSearcher=true&wt=javabin&openSearcher=false} {commit=} 0 10
[junit4:junit4] 2> 498618 T929 C8539 P54293 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 498619 T929 C8539 P54293 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 498621 T884 C8540 P55299 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 498622 T884 C8540 P55299 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&version=2&command=indexversion&wt=javabin} status=0 QTime=1
[junit4:junit4] 2> 498623 T929 C8539 P54293 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 498624 T929 C8539 P54293 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 498627 T929 C8539 P54293 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 498629 T885 C8540 P55299 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&version=2&generation=2&command=filelist&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> 498632 T929 C8539 P54293 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 498635 T929 C8539 P54293 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty4/index.20130614151502697
[junit4:junit4] 2> 498635 T929 C8539 P54293 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@7c547c54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@32b032b) fullCopy=false
[junit4:junit4] 2> 498638 T887 C8540 P55299 oasc.SolrCore.execute [collection1] webapp= path=/replication params={checksum=true&qt=/replication&generation=2&command=filecontent&file=segments_2&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C8541 name=collection1 org.apache.solr.core.SolrCore@4e464e46 url=http://127.0.0.1:54293/collection1 node=127.0.0.1:54293_ C8541_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:54293, state=recovering, node_name=127.0.0.1:54293_, collection=collection1, shard=shard2, core=collection1}
[junit4:junit4] 2> 498691 T929 C8541 P54293 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 498693 T929 C8541 P54293 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 498694 T929 C8541 P54293 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 498696 T929 C8541 P54293 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@639a639a lockFactory=org.apache.lucene.store.NativeFSLockFactory@786e786e),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@639a639a lockFactory=org.apache.lucene.store.NativeFSLockFactory@786e786e),segFN=segments_2,generation=2}
[junit4:junit4] 2> 498697 T929 C8541 P54293 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 498698 T929 C8541 P54293 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 498699 T929 C8541 P54293 oass.SolrIndexSearcher.<init> Opening Searcher@6f516f51 main
[junit4:junit4] 2> 498700 T928 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6f516f51 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 498702 T929 C8541 P54293 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty4/index.20130614151502697 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty4/index.20130614151502697;done=true>>]
[junit4:junit4] 2> 498702 T929 C8541 P54293 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty4/index.20130614151502697
[junit4:junit4] 2> 498704 T929 C8541 P54293 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty4/index.20130614151502697
[junit4:junit4] 2> 498704 T929 C8541 P54293 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 498705 T929 C8541 P54293 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 498706 T929 C8541 P54293 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 498706 T929 C8541 P54293 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 498709 T929 C8541 P54293 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 498773 T856 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 498790 T856 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:54293",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:54293__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:54293_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 498798 T924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 498799 T875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 498799 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 498799 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 498802 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 498805 T862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 498840 T868 oasc.ZkController.register We are http://127.0.0.1:36437/onenodecollectioncore/ and leader is http://127.0.0.1:36437/onenodecollectioncore/
[junit4:junit4] 2> 498842 T868 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:36437
[junit4:junit4] 2> 498843 T868 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 498843 T868 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4] 2> 498848 T868 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 498851 T868 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1371176076012/onenodecollection&action=CREATE&version=2&numShards=1&name=onenodecollectioncore&wt=javabin&roles=none&collection=onenodecollection} status=0 QTime=4269
[junit4:junit4] 2> 498852 T833 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 498853 T833 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 499856 T833 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 500319 T856 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 500321 T856 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36437",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:36437__onenodecollectioncore",
[junit4:junit4] 2> "node_name":"127.0.0.1:36437_",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"onenodecollectioncore"}
[junit4:junit4] 2> 500334 T862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 500334 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 500334 T875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 500334 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 500334 T924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 500335 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 500859 T833 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 500861 T833 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4] 2> 500862 T833 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 500885 T833 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 500892 T935 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@397b397b name:ZooKeeperConnection Watcher:127.0.0.1:59796 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 500893 T833 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 501079 T833 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 46181
[junit4:junit4] 2> 501080 T833 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1590648527
[junit4:junit4] 2> 501863 T856 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 501865 T856 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46181",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:46181__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:46181_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 501877 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 501877 T924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 501881 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 501881 T875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 501881 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 503082 T833 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 503083 T833 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 503086 T833 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@5e705e70
[junit4:junit4] 2> 503091 T833 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 503092 T833 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 503093 T833 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 503094 T833 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 503096 T833 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 503097 T833 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 503097 T833 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/control/data [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/control/data;done=false>>]
[junit4:junit4] 2> 503098 T833 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/control/data
[junit4:junit4] 2> 503099 T833 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/control/data/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/control/data/index;done=false>>]
[junit4:junit4] 2> 503100 T833 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/control/data/index
[junit4:junit4] 2> 503104 T856 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89861395317784579-127.0.0.1:46181_-n_0000000000) am no longer a leader.
[junit4:junit4] 2> 503107 T891 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 503108 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 503108 T924 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 503108 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 503109 T924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 503107 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 503110 T855 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 503111 T875 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 503112 T855 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 503115 T907 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 503138 T875 oasc.Overseer.start Overseer (id=89861395317784582-127.0.0.1:36437_-n_0000000001) starting
[junit4:junit4] 2> 503151 T875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 503152 T937 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 503156 T875 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 503159 T936 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 503160 T833 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 503167 T936 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 503170 T936 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46181",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:46181__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:46181_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 503181 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 503181 T924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 503181 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 503187 T875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 503213 T833 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 36437
[junit4:junit4] 2> 503214 T833 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=203492385
[junit4:junit4] 2> 504702 T936 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 504704 T936 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36437",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:36437__onenodecollectioncore",
[junit4:junit4] 2> "node_name":"127.0.0.1:36437_",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"onenodecollectioncore"}
[junit4:junit4] 2> 504715 T936 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36437",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:36437__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:36437_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 504722 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 504723 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 504723 T924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 504722 T875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 506219 T833 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 506220 T833 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 506223 T833 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 506224 T833 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@b2d0b2d
[junit4:junit4] 2> 506232 T833 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 506233 T833 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 506234 T833 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 506235 T833 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 506250 T936 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 506251 T833 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 506252 T936 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36437",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:36437__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:36437_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 506252 T833 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 506255 T833 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty1 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty1;done=false>>]
[junit4:junit4] 2> 506256 T833 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty1
[junit4:junit4] 2> 506257 T833 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty1/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty1/index;done=false>>]
[junit4:junit4] 2> 506258 T833 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty1/index
[junit4:junit4] 2> 506262 T833 oasc.SolrCore.close [onenodecollectioncore] CLOSING SolrCore org.apache.solr.core.SolrCore@734b734b
[junit4:junit4] 2> 506273 T833 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 506274 T833 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 506275 T833 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 506276 T833 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 506277 T936 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36437",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:36437__onenodecollectioncore",
[junit4:junit4] 2> "node_name":"127.0.0.1:36437_",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"onenodecollectioncore"}
[junit4:junit4] 2> 506278 T833 oasc.SolrCore.closeSearcher [onenodecollectioncore] Closing main searcher on request.
[junit4:junit4] 2> 506279 T833 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 506280 T833 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1371176076012/onenodecollection/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1371176076012/onenodecollection/index;done=false>>]
[junit4:junit4] 2> 506280 T833 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1371176076012/onenodecollection/index
[junit4:junit4] 2> 506281 T833 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1371176076012/onenodecollection [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1371176076012/onenodecollection;done=false>>]
[junit4:junit4] 2> 506282 T833 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1371176076012/onenodecollection
[junit4:junit4] 2> 506286 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 506286 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 506286 T924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 506290 T875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 506297 T891 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 506297 T924 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 506298 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 506298 T924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 506299 T907 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 506304 T891 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 506308 T907 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4:junit4] 2> 506309 T907 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4:junit4] 2> 506309 T907 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 506310 T907 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:34599/collection1/
[junit4:junit4] 2> 506311 T907 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:34599 START replicas=[http://127.0.0.1:36437/collection1/] nUpdates=100
[junit4:junit4] 2> 506312 T907 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:34599 DONE. We have no versions. sync failed.
[junit4:junit4] 2> 506313 T907 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 506314 T907 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 506314 T907 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:34599/collection1/
[junit4:junit4] 2> 506315 T907 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 506320 T833 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 506321 T891 oasc.Overseer.start Overseer (id=89861395317784584-127.0.0.1:55299_-n_0000000002) starting
[junit4:junit4] 2> 506330 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 506335 T907 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 506353 T940 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 506396 T833 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 55299
[junit4:junit4] 2> 506397 T833 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1378767406
[junit4:junit4] 2> 506405 T939 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 506408 T939 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4:junit4] 2> 506410 T939 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36437",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:36437__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:36437_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 506412 T924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 506412 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 506413 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 506431 T939 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36437",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:36437__onenodecollectioncore",
[junit4:junit4] 2> "node_name":"127.0.0.1:36437_",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"onenodecollectioncore"}
[junit4:junit4] 2> 506434 T924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 506436 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 506447 T939 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 506453 T939 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 506470 T939 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55299",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:55299__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:55299_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 506478 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 506478 T924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 506478 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 507404 T833 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 507405 T833 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 507407 T833 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@41494149
[junit4:junit4] 2> 507413 T833 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 507414 T833 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 507415 T833 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 507416 T833 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 507419 T833 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 507420 T833 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 507420 T833 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty2/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty2/index;done=false>>]
[junit4:junit4] 2> 507421 T833 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty2/index
[junit4:junit4] 2> 507422 T833 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty2 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty2;done=false>>]
[junit4:junit4] 2> 507423 T833 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty2
[junit4:junit4] 2> 507425 T939 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89861395317784584-127.0.0.1:55299_-n_0000000002) am no longer a leader.
[junit4:junit4] 2> 507427 T835 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f407682f00008, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:738)
[junit4:junit4] 2>
[junit4:junit4] 2> 507433 T924 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 507433 T907 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 507509 T924 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4:junit4] 2> 507509 T924 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4:junit4] 2> 507509 T907 oasc.Overseer.start Overseer (id=89861395317784586-127.0.0.1:34599_-n_0000000003) starting
[junit4:junit4] 2> 507510 T924 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 507511 T924 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54293/collection1/
[junit4:junit4] 2> 507512 T924 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:54293 START replicas=[http://127.0.0.1:55299/collection1/] nUpdates=100
[junit4:junit4] 2> 507513 T924 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:54293 DONE. We have no versions. sync failed.
[junit4:junit4] 2> 507514 T924 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 507514 T833 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 507515 T924 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 507517 T924 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54293/collection1/
[junit4:junit4] 2> 507518 T924 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 507522 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 507522 T943 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 507528 T907 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 507530 T942 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 507534 T924 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 507535 T924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 507535 T942 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 507537 T942 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55299",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:55299__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:55299_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 507556 T924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 507556 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 507567 T833 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 34599
[junit4:junit4] 2> 507568 T833 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=801845195
[junit4:junit4] 2> 507595 T875 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 507596 T875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 507596 T875 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 507597 T875 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 508572 T833 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 508573 T833 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 508576 T833 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@3dc93dc9
[junit4:junit4] 2> 508581 T833 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 508582 T833 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 508582 T833 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 508583 T833 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 508584 T833 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 508585 T833 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 508591 T833 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty3/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty3/index;done=false>>]
[junit4:junit4] 2> 508591 T833 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty3/index
[junit4:junit4] 2> 508592 T833 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty3 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty3;done=false>>]
[junit4:junit4] 2> 508593 T833 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty3
[junit4:junit4] 2> 508595 T942 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89861395317784586-127.0.0.1:34599_-n_0000000003) am no longer a leader.
[junit4:junit4] 2> 508608 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 508608 T907 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 508609 T907 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 508615 T924 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 508625 T924 oasc.Overseer.start Overseer (id=89861395317784588-127.0.0.1:54293_-n_0000000004) starting
[junit4:junit4] 2> 508629 T833 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 508637 T924 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4] 2> 508638 T924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 508640 T945 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 508644 T944 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 508666 T944 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 508668 T944 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34599",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:34599__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:34599_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 508682 T833 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 54293
[junit4:junit4] 2> 508683 T833 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1349537904
[junit4:junit4] 2> 508691 T944 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34599",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:34599__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:34599_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 508697 T944 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:54293",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:54293__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:54293_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 508705 T924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 508726 T891 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 508727 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 508728 T891 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 509691 T833 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 509692 T833 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 509694 T833 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@4e464e46
[junit4:junit4] 2> 509706 T833 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 509707 T833 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 509708 T833 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 509709 T833 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 509711 T833 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 509711 T833 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 509712 T833 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty4;done=false>>]
[junit4:junit4] 2> 509713 T833 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty4
[junit4:junit4] 2> 509714 T833 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty4/index;done=false>>]
[junit4:junit4] 2> 509714 T833 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1371176076012/jetty4/index
[junit4:junit4] 2> 509717 T944 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89861395317784588-127.0.0.1:54293_-n_0000000004) am no longer a leader.
[junit4:junit4] 2> 509741 T833 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 509805 T833 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 509807 T833 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:59796 59796
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 1> / (2)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr (7)
[junit4:junit4] 1> /solr/configs (1)
[junit4:junit4] 1> /solr/configs/conf1 (9)
[junit4:junit4] 1> /solr/configs/conf1/old_synonyms.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/protwords.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/stopwords.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/synonyms.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/schema.xml (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/currency.xml (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/open-exchange-rates.json (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "disclaimer": "This data is not real, it was synthetically created to match currency.xml. It is modeled after the data format available from openexchangerates.org. See https://openexchangerates.org/documentation for details",
[junit4:junit4] 1> "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4:junit4] 1> "timestamp": 1332070464,
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 1> "IMPORTANT NOTE": "In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 1> "base": "USD",
[junit4:junit4] 1> "rates": {
[junit4:junit4] 1> "USD": 1,
[junit4:junit4] 1> "JPY": 81.29,
[junit4:junit4] 1> "EUR": 2.5,
[junit4:junit4] 1> "GBP": 0.5,
[junit4:junit4] 1> "MXN": 2.0
[junit4:junit4] 1> }
[junit4:junit4] 1> }
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/configs/conf1/solrconfig.xml (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/overseer (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/overseer/queue (0)
[junit4:junit4] 1> /solr/overseer/collection-queue-work (0)
[junit4:junit4] 1> /solr/overseer/queue-work (0)
[junit4:junit4] 1> /solr/overseer_elect (2)
[junit4:junit4] 1> /solr/overseer_elect/leader (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"id":"89861395317784579-127.0.0.1:46181_-n_0000000000"}
[junit4:junit4] 1> /solr/overseer_elect/election (5)
[junit4:junit4] 1> /solr/overseer_elect/election/89861395317784586-127.0.0.1:34599_-n_0000000003 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89861395317784584-127.0.0.1:55299_-n_0000000002 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89861395317784582-127.0.0.1:36437_-n_0000000001 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89861395317784588-127.0.0.1:54293_-n_0000000004 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89861395317784579-127.0.0.1:46181_-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections (3)
[junit4:junit4] 1> /solr/collections/control_collection (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election/89861395317784579-127.0.0.1:46181__collection1-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/control_collection/leaders (1)
[junit4:junit4] 1> /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "base_url":"http://127.0.0.1:46181",
[junit4:junit4] 1> "node_name":"127.0.0.1:46181_",
[junit4:junit4] 1> "core":"collection1"}
[junit4:junit4] 1> /solr/collections/control_collection/shards (0)
[junit4:junit4] 1> /solr/collections/collection1 (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/collection1/leader_elect (2)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election (2)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89861395317784586-127.0.0.1:34599__
[...truncated too long message...]
decollection/leader_elect/shard1/election (1)
[junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect/shard1/election/89861395317784582-127.0.0.1:36437__onenodecollectioncore-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/onenodecollection/leaders (1)
[junit4:junit4] 1> /solr/collections/onenodecollection/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "base_url":"http://127.0.0.1:36437",
[junit4:junit4] 1> "node_name":"127.0.0.1:36437_",
[junit4:junit4] 1> "core":"onenodecollectioncore"}
[junit4:junit4] 1> /solr/aliases.json (0)
[junit4:junit4] 1> /solr/live_nodes (5)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:34599_ (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:55299_ (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:46181_ (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:54293_ (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:36437_ (0)
[junit4:junit4] 1> /solr/clusterstate.json (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "control_collection":{
[junit4:junit4] 1> "shards":{"shard1":{
[junit4:junit4] 1> "range":"80000000-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{"127.0.0.1:46181__collection1":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:46181",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "node_name":"127.0.0.1:46181_",
[junit4:junit4] 1> "collection":"control_collection",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "leader":"true"}}}},
[junit4:junit4] 1> "router":"compositeId"},
[junit4:junit4] 1> "onenodecollection":{
[junit4:junit4] 1> "shards":{"shard1":{
[junit4:junit4] 1> "range":"80000000-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{"127.0.0.1:36437__onenodecollectioncore":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:36437",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "node_name":"127.0.0.1:36437_",
[junit4:junit4] 1> "roles":"none",
[junit4:junit4] 1> "collection":"onenodecollection",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "core":"onenodecollectioncore",
[junit4:junit4] 1> "leader":"true"}}}},
[junit4:junit4] 1> "router":"compositeId"},
[junit4:junit4] 1> "collection1":{
[junit4:junit4] 1> "shards":{
[junit4:junit4] 1> "shard1":{
[junit4:junit4] 1> "range":"80000000-ffffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{
[junit4:junit4] 1> "127.0.0.1:36437__collection1":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:36437",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "node_name":"127.0.0.1:36437_",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "leader":"true"},
[junit4:junit4] 1> "127.0.0.1:34599__collection1":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:34599",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "node_name":"127.0.0.1:34599_",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "core":"collection1"}}},
[junit4:junit4] 1> "shard2":{
[junit4:junit4] 1> "range":"0-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{
[junit4:junit4] 1> "127.0.0.1:55299__collection1":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:55299",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "node_name":"127.0.0.1:55299_",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard":"shard2",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "leader":"true"},
[junit4:junit4] 1> "127.0.0.1:54293__collection1":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:54293",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "node_name":"127.0.0.1:54293_",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard":"shard2",
[junit4:junit4] 1> "core":"collection1"}}}},
[junit4:junit4] 1> "router":"compositeId"}}
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=7FBC5F4E10045FE1 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=be -Dtests.timezone=Pacific/Fakaofo -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR 37.9s J1 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:55299/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([7FBC5F4E10045FE1:FE5AD156675B3FDD]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:198)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:90)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:738)
[junit4:junit4] 2> 509867 T833 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 37942 T832 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 511020 T924 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 511021 T924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 511021 T924 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Lucene3x, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=be, timezone=Pacific/Fakaofo
[junit4:junit4] 2> NOTE: Linux 3.2.0-45-generic x86/IBM Corporation 1.6.0 (32-bit)/cpus=8,threads=3,free=20347120,total=43081216
[junit4:junit4] 2> NOTE: All tests run in this JVM: [SolrCoreCheckLockOnStartupTest, FileUtilsTest, TestMergePolicyConfig, TestSolrXMLSerializer, TestBinaryField, TestWordDelimiterFilterFactory, ChaosMonkeyShardSplitTest, TestStressReorder, DefaultValueUpdateProcessorTest, TestQuerySenderNoQuery, SignatureUpdateProcessorFactoryTest, NotRequiredUniqueKeyTest, SolrRequestParserTest, ConvertedLegacyTest, SolrIndexConfigTest, TestRandomFaceting, TestSolrXml, OpenCloseCoreStressTest, TermVectorComponentDistributedTest, EchoParamsTest, UpdateParamsTest, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 39.23s, 1 test, 1 error <<< FAILURES!
[...truncated 771 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:391: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:384: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:437: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1243: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:887: There were test failures: 297 suites, 1246 tests, 1 error, 14 ignored (8 assumptions)
Total time: 48 minutes 43 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/ibm-j9-jdk6 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure