You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/11/09 11:49:24 UTC
[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.6.0_45) - Build # 8143
- Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/8143/
Java: 32bit/jdk1.6.0_45 -client -XX:+UseSerialGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
shard2 is not consistent. Got 32 from http://127.0.0.1:57316/collection1lastClient and got 29 from http://127.0.0.1:45495/collection1
Stack Trace:
java.lang.AssertionError: shard2 is not consistent. Got 32 from http://127.0.0.1:57316/collection1lastClient and got 29 from http://127.0.0.1:45495/collection1
at __randomizedtesting.SeedInfo.seed([A3B40B43DAA5D33F:2252855BADFAB303]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1151)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:135)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:662)
Build Log:
[...truncated 9861 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> 711094 T2009 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 711098 T2009 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-ChaosMonkeySafeLeaderTest-1383993355949
[junit4] 2> 711099 T2009 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 711100 T2010 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 711200 T2009 oasc.ZkTestServer.run start zk server on port:39739
[junit4] 2> 711201 T2009 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 711247 T2016 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b98610 name:ZooKeeperConnection Watcher:127.0.0.1:39739 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 711247 T2009 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 711247 T2009 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 711253 T2009 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 711254 T2018 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1830b05 name:ZooKeeperConnection Watcher:127.0.0.1:39739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 711255 T2009 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 711255 T2009 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 711261 T2009 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 711265 T2009 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 711268 T2009 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 711272 T2009 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 711273 T2009 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 711279 T2009 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 711279 T2009 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 711284 T2009 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 711284 T2009 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 711289 T2009 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 711289 T2009 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 711293 T2009 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 711294 T2009 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 711297 T2009 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 711298 T2009 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 711301 T2009 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 711302 T2009 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 711306 T2009 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 711306 T2009 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 711310 T2009 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 711310 T2009 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 711315 T2009 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 711315 T2009 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 711320 T2009 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 711321 T2009 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 711389 T2009 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 711392 T2009 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:57505
[junit4] 2> 711392 T2009 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 711393 T2009 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 711393 T2009 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1383993356175
[junit4] 2> 711393 T2009 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1383993356175/'
[junit4] 2> 711405 T2009 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1383993356175/solr.xml
[junit4] 2> 711452 T2009 oasc.CoreContainer.<init> New CoreContainer 27687365
[junit4] 2> 711453 T2009 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1383993356175/]
[junit4] 2> 711454 T2009 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 711454 T2009 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 711454 T2009 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 711455 T2009 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 711455 T2009 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 711456 T2009 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 711456 T2009 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 711456 T2009 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 711457 T2009 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 711458 T2009 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 711458 T2009 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 711459 T2009 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:39739/solr
[junit4] 2> 711459 T2009 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 711460 T2009 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 711462 T2029 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@184c65d name:ZooKeeperConnection Watcher:127.0.0.1:39739 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 711463 T2009 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 711467 T2009 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 711468 T2031 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@160e1bb name:ZooKeeperConnection Watcher:127.0.0.1:39739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 711469 T2009 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 711471 T2009 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 711475 T2009 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 711480 T2009 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 711483 T2009 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57505_
[junit4] 2> 711484 T2009 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57505_
[junit4] 2> 711489 T2009 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 711495 T2009 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 711500 T2009 oasc.Overseer.start Overseer (id=90701388575670275-127.0.0.1:57505_-n_0000000000) starting
[junit4] 2> 711504 T2009 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 711510 T2033 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 711512 T2009 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 711516 T2009 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 711519 T2009 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 711523 T2032 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 711526 T2034 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 711526 T2034 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 711527 T2034 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 713029 T2032 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 713030 T2032 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:57505",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:57505_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 713030 T2032 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 713030 T2032 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 713035 T2031 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 713527 T2034 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 713528 T2034 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1383993356175/collection1
[junit4] 2> 713528 T2034 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 713530 T2034 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 713531 T2034 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 713534 T2034 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1383993356175/collection1/'
[junit4] 2> 713535 T2034 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1383993356175/collection1/lib/classes/' to classloader
[junit4] 2> 713536 T2034 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1383993356175/collection1/lib/README' to classloader
[junit4] 2> 713601 T2034 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
[junit4] 2> 713668 T2034 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 713670 T2034 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 713678 T2034 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 714142 T2034 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 714143 T2034 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 714143 T2034 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 714149 T2034 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 714153 T2034 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 714176 T2034 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 714180 T2034 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 714184 T2034 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 714186 T2034 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 714186 T2034 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 714186 T2034 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 714188 T2034 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 714188 T2034 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 714188 T2034 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 714194 T2034 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1383993356175/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/control/data/
[junit4] 2> 714194 T2034 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@18c74
[junit4] 2> 714195 T2034 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/control/data
[junit4] 2> 714195 T2034 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/control/data/index/
[junit4] 2> 714196 T2034 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 714196 T2034 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/control/data/index
[junit4] 2> 714196 T2034 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=88.3984375, floorSegmentMB=1.2802734375, forceMergeDeletesPctAllowed=0.6591128451302708, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 714199 T2034 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 714199 T2034 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 714201 T2034 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 714201 T2034 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 714202 T2034 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 714202 T2034 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 714202 T2034 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 714202 T2034 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 714203 T2034 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 714203 T2034 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 714203 T2034 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 714204 T2034 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 714204 T2034 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 714204 T2034 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 714205 T2034 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 714205 T2034 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 714205 T2034 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 714207 T2034 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 714210 T2034 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 714210 T2034 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 714211 T2034 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=35.4560546875, floorSegmentMB=0.869140625, forceMergeDeletesPctAllowed=4.352595111722268, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 714212 T2034 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 714212 T2034 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 714212 T2034 oass.SolrIndexSearcher.<init> Opening Searcher@c7d5cf main
[junit4] 2> 714215 T2035 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c7d5cf main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 714216 T2034 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 714216 T2034 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:57505 collection:control_collection shard:shard1
[junit4] 2> 714218 T2034 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 714227 T2034 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 714231 T2034 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 714231 T2034 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 714231 T2034 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:57505/collection1/
[junit4] 2> 714231 T2034 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 714232 T2034 oasc.SyncStrategy.syncToMe http://127.0.0.1:57505/collection1/ has no replicas
[junit4] 2> 714232 T2034 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:57505/collection1/ shard1
[junit4] 2> 714232 T2034 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 714544 T2032 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 714567 T2031 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 714594 T2034 oasc.ZkController.register We are http://127.0.0.1:57505/collection1/ and leader is http://127.0.0.1:57505/collection1/
[junit4] 2> 714594 T2034 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57505
[junit4] 2> 714594 T2034 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 714595 T2034 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 714595 T2034 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 714598 T2034 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 714601 T2009 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 714602 T2009 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 714605 T2009 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 714607 T2038 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cce823 name:ZooKeeperConnection Watcher:127.0.0.1:39739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 714608 T2009 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 714612 T2009 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 714621 T2009 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 714687 T2009 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 714689 T2009 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:48992
[junit4] 2> 714690 T2009 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 714691 T2009 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 714691 T2009 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1383993359472
[junit4] 2> 714692 T2009 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1383993359472/'
[junit4] 2> 714709 T2009 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1383993359472/solr.xml
[junit4] 2> 714757 T2009 oasc.CoreContainer.<init> New CoreContainer 28290798
[junit4] 2> 714758 T2009 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1383993359472/]
[junit4] 2> 714759 T2009 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 714759 T2009 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 714760 T2009 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 714760 T2009 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 714760 T2009 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 714761 T2009 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 714761 T2009 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 714761 T2009 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 714762 T2009 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 714763 T2009 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 714763 T2009 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 714764 T2009 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:39739/solr
[junit4] 2> 714764 T2009 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 714765 T2009 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 714767 T2049 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@105a9df name:ZooKeeperConnection Watcher:127.0.0.1:39739 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 714768 T2009 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 714772 T2009 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 714773 T2051 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c748e3 name:ZooKeeperConnection Watcher:127.0.0.1:39739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 714773 T2009 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 714779 T2009 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 715785 T2009 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48992_
[junit4] 2> 715788 T2009 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48992_
[junit4] 2> 715799 T2038 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 715800 T2031 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 715801 T2051 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 715819 T2052 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 715820 T2052 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 715822 T2052 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 716083 T2032 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 716085 T2032 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:57505",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:57505_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 716096 T2032 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:48992",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:48992_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 716097 T2032 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 716097 T2032 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 716109 T2038 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 716109 T2051 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 716109 T2031 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 716822 T2052 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 716823 T2052 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1383993359472/collection1
[junit4] 2> 716823 T2052 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 716825 T2052 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 716826 T2052 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 716829 T2052 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1383993359472/collection1/'
[junit4] 2> 716830 T2052 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1383993359472/collection1/lib/classes/' to classloader
[junit4] 2> 716831 T2052 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1383993359472/collection1/lib/README' to classloader
[junit4] 2> 716901 T2052 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
[junit4] 2> 716962 T2052 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 716966 T2052 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 716975 T2052 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 717487 T2052 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 717487 T2052 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 717488 T2052 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 717494 T2052 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 717498 T2052 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 717517 T2052 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 717521 T2052 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 717525 T2052 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 717526 T2052 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 717527 T2052 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 717527 T2052 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 717529 T2052 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 717529 T2052 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 717529 T2052 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 717529 T2052 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1383993359472/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty1/
[junit4] 2> 717530 T2052 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@18c74
[junit4] 2> 717530 T2052 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty1
[junit4] 2> 717537 T2052 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty1/index/
[junit4] 2> 717537 T2052 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 717538 T2052 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty1/index
[junit4] 2> 717538 T2052 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=88.3984375, floorSegmentMB=1.2802734375, forceMergeDeletesPctAllowed=0.6591128451302708, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 717540 T2052 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 717540 T2052 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 717543 T2052 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 717543 T2052 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 717544 T2052 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 717544 T2052 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 717544 T2052 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 717544 T2052 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 717545 T2052 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 717545 T2052 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 717545 T2052 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 717546 T2052 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 717546 T2052 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 717546 T2052 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 717547 T2052 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 717547 T2052 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 717548 T2052 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 717550 T2052 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 717552 T2052 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 717552 T2052 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 717553 T2052 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=35.4560546875, floorSegmentMB=0.869140625, forceMergeDeletesPctAllowed=4.352595111722268, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 717555 T2052 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 717555 T2052 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 717556 T2052 oass.SolrIndexSearcher.<init> Opening Searcher@177a8d8 main
[junit4] 2> 717564 T2053 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@177a8d8 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 717567 T2052 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 717568 T2052 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48992 collection:collection1 shard:shard1
[junit4] 2> 717571 T2052 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 717590 T2052 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 717598 T2052 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 717599 T2052 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 717599 T2052 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:48992/collection1/
[junit4] 2> 717600 T2052 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 717600 T2052 oasc.SyncStrategy.syncToMe http://127.0.0.1:48992/collection1/ has no replicas
[junit4] 2> 717601 T2052 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:48992/collection1/ shard1
[junit4] 2> 717601 T2052 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 717626 T2032 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 717647 T2038 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 717647 T2051 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 717647 T2031 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 717670 T2052 oasc.ZkController.register We are http://127.0.0.1:48992/collection1/ and leader is http://127.0.0.1:48992/collection1/
[junit4] 2> 717670 T2052 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48992
[junit4] 2> 717670 T2052 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 717670 T2052 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 717671 T2052 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 717673 T2052 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 717674 T2009 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 717675 T2009 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 717748 T2009 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 717750 T2009 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54553
[junit4] 2> 717751 T2009 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 717751 T2009 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 717752 T2009 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1383993362526
[junit4] 2> 717752 T2009 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1383993362526/'
[junit4] 2> 717764 T2009 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1383993362526/solr.xml
[junit4] 2> 717813 T2009 oasc.CoreContainer.<init> New CoreContainer 19728702
[junit4] 2> 717813 T2009 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1383993362526/]
[junit4] 2> 717815 T2009 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 717815 T2009 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 717815 T2009 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 717816 T2009 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 717816 T2009 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 717816 T2009 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 717817 T2009 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 717817 T2009 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 717818 T2009 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 717819 T2009 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 717819 T2009 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 717820 T2009 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:39739/solr
[junit4] 2> 717820 T2009 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 717821 T2009 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 717822 T2065 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b9d56f name:ZooKeeperConnection Watcher:127.0.0.1:39739 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 717823 T2009 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 717846 T2009 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 717847 T2067 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5814ac name:ZooKeeperConnection Watcher:127.0.0.1:39739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 717848 T2009 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 717854 T2009 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 718859 T2009 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54553_
[junit4] 2> 718862 T2009 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54553_
[junit4] 2> 718874 T2031 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 718874 T2038 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 718876 T2051 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 718877 T2067 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 718893 T2068 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 718893 T2068 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 718896 T2068 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 719158 T2032 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 719159 T2032 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:48992",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:48992_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 719166 T2032 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:54553",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:54553_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 719167 T2032 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 719167 T2032 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 719174 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 719174 T2038 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 719174 T2051 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 719174 T2031 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 719896 T2068 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 719897 T2068 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1383993362526/collection1
[junit4] 2> 719897 T2068 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 719899 T2068 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 719899 T2068 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 719901 T2068 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1383993362526/collection1/'
[junit4] 2> 719902 T2068 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1383993362526/collection1/lib/classes/' to classloader
[junit4] 2> 719902 T2068 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1383993362526/collection1/lib/README' to classloader
[junit4] 2> 719951 T2068 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
[junit4] 2> 720010 T2068 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 720012 T2068 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 720021 T2068 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 720487 T2068 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 720488 T2068 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 720489 T2068 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 720495 T2068 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 720499 T2068 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 720516 T2068 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 720521 T2068 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 720525 T2068 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 720527 T2068 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 720527 T2068 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 720527 T2068 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 720529 T2068 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 720529 T2068 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 720529 T2068 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 720530 T2068 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1383993362526/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty2/
[junit4] 2> 720530 T2068 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@18c74
[junit4] 2> 720530 T2068 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty2
[junit4] 2> 720531 T2068 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty2/index/
[junit4] 2> 720531 T2068 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 720531 T2068 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty2/index
[junit4] 2> 720532 T2068 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=88.3984375, floorSegmentMB=1.2802734375, forceMergeDeletesPctAllowed=0.6591128451302708, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 720534 T2068 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 720534 T2068 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 720537 T2068 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 720537 T2068 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 720538 T2068 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 720538 T2068 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 720538 T2068 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 720538 T2068 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 720539 T2068 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 720539 T2068 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 720539 T2068 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 720540 T2068 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 720540 T2068 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 720541 T2068 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 720541 T2068 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 720541 T2068 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 720542 T2068 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 720544 T2068 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 720546 T2068 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 720547 T2068 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 720547 T2068 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=35.4560546875, floorSegmentMB=0.869140625, forceMergeDeletesPctAllowed=4.352595111722268, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 720548 T2068 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 720549 T2068 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 720549 T2068 oass.SolrIndexSearcher.<init> Opening Searcher@1f73dd5 main
[junit4] 2> 720553 T2069 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1f73dd5 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 720555 T2068 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 720555 T2068 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54553 collection:collection1 shard:shard2
[junit4] 2> 720563 T2068 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 720572 T2068 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 720575 T2068 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 720575 T2068 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 720575 T2068 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54553/collection1/
[junit4] 2> 720576 T2068 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 720576 T2068 oasc.SyncStrategy.syncToMe http://127.0.0.1:54553/collection1/ has no replicas
[junit4] 2> 720576 T2068 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54553/collection1/ shard2
[junit4] 2> 720576 T2068 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 720689 T2032 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 720699 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 720699 T2038 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 720699 T2031 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 720700 T2051 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 720735 T2068 oasc.ZkController.register We are http://127.0.0.1:54553/collection1/ and leader is http://127.0.0.1:54553/collection1/
[junit4] 2> 720736 T2068 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54553
[junit4] 2> 720736 T2068 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 720736 T2068 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 720736 T2068 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 720739 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 720740 T2009 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 720741 T2009 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 720818 T2009 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 720821 T2009 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:43470
[junit4] 2> 720821 T2009 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 720822 T2009 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 720822 T2009 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1383993365592
[junit4] 2> 720822 T2009 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1383993365592/'
[junit4] 2> 720835 T2009 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1383993365592/solr.xml
[junit4] 2> 720875 T2009 oasc.CoreContainer.<init> New CoreContainer 4468042
[junit4] 2> 720875 T2009 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1383993365592/]
[junit4] 2> 720877 T2009 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 720877 T2009 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 720877 T2009 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 720878 T2009 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 720878 T2009 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 720878 T2009 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 720879 T2009 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 720879 T2009 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 720880 T2009 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 720881 T2009 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 720881 T2009 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 720882 T2009 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:39739/solr
[junit4] 2> 720882 T2009 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 720883 T2009 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 720885 T2081 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f986a6 name:ZooKeeperConnection Watcher:127.0.0.1:39739 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 720885 T2009 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 720888 T2009 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 720890 T2083 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1787759 name:ZooKeeperConnection Watcher:127.0.0.1:39739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 720890 T2009 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 720896 T2009 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 721901 T2009 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43470_
[junit4] 2> 721902 T2009 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43470_
[junit4] 2> 721907 T2051 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 721908 T2067 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 721909 T2083 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 721910 T2031 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 721910 T2038 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 721918 T2084 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 721918 T2084 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 721927 T2084 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 722210 T2032 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 722211 T2032 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:54553",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:54553_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 722216 T2032 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:43470",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:43470_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 722217 T2032 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 722217 T2032 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 722223 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 722223 T2038 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 722224 T2031 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 722224 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 722224 T2051 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 722928 T2084 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 722928 T2084 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1383993365592/collection1
[junit4] 2> 722928 T2084 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 722929 T2084 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 722930 T2084 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 722931 T2084 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1383993365592/collection1/'
[junit4] 2> 722932 T2084 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1383993365592/collection1/lib/classes/' to classloader
[junit4] 2> 722932 T2084 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1383993365592/collection1/lib/README' to classloader
[junit4] 2> 722971 T2084 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
[junit4] 2> 723020 T2084 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 723022 T2084 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 723030 T2084 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 723540 T2084 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 723541 T2084 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 723541 T2084 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 723548 T2084 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 723551 T2084 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 723579 T2084 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 723588 T2084 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 723596 T2084 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 723599 T2084 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 723600 T2084 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 723600 T2084 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 723604 T2084 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 723604 T2084 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 723605 T2084 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 723605 T2084 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1383993365592/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty3/
[junit4] 2> 723606 T2084 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@18c74
[junit4] 2> 723607 T2084 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty3
[junit4] 2> 723608 T2084 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty3/index/
[junit4] 2> 723608 T2084 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty3/index' doesn't exist. Creating new index...
[junit4] 2> 723609 T2084 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty3/index
[junit4] 2> 723610 T2084 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=88.3984375, floorSegmentMB=1.2802734375, forceMergeDeletesPctAllowed=0.6591128451302708, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 723613 T2084 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty3/index,segFN=segments_1,generation=1}
[junit4] 2> 723613 T2084 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 723622 T2084 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 723623 T2084 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 723624 T2084 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 723625 T2084 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 723626 T2084 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 723626 T2084 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 723627 T2084 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 723628 T2084 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 723628 T2084 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 723629 T2084 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 723630 T2084 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 723630 T2084 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 723631 T2084 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 723632 T2084 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 723632 T2084 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 723635 T2084 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 723640 T2084 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 723640 T2084 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 723642 T2084 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=35.4560546875, floorSegmentMB=0.869140625, forceMergeDeletesPctAllowed=4.352595111722268, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 723644 T2084 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty3/index,segFN=segments_1,generation=1}
[junit4] 2> 723644 T2084 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 723645 T2084 oass.SolrIndexSearcher.<init> Opening Searcher@585191 main
[junit4] 2> 723651 T2085 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@585191 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 723653 T2084 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 723653 T2084 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:43470 collection:collection1 shard:shard3
[junit4] 2> 723655 T2084 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 723664 T2084 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 723668 T2084 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 723668 T2084 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 723668 T2084 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:43470/collection1/
[junit4] 2> 723669 T2084 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 723669 T2084 oasc.SyncStrategy.syncToMe http://127.0.0.1:43470/collection1/ has no replicas
[junit4] 2> 723669 T2084 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:43470/collection1/ shard3
[junit4] 2> 723669 T2084 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 723737 T2032 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 723748 T2031 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 723748 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 723748 T2038 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 723748 T2051 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 723748 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 723778 T2084 oasc.ZkController.register We are http://127.0.0.1:43470/collection1/ and leader is http://127.0.0.1:43470/collection1/
[junit4] 2> 723779 T2084 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:43470
[junit4] 2> 723779 T2084 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 723780 T2084 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 723780 T2084 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 723785 T2084 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 723788 T2009 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 723789 T2009 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 723873 T2009 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 723876 T2009 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:41808
[junit4] 2> 723876 T2009 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 723877 T2009 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 723877 T2009 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1383993368641
[junit4] 2> 723877 T2009 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1383993368641/'
[junit4] 2> 723890 T2009 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1383993368641/solr.xml
[junit4] 2> 723930 T2009 oasc.CoreContainer.<init> New CoreContainer 21007719
[junit4] 2> 723930 T2009 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1383993368641/]
[junit4] 2> 723931 T2009 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 723932 T2009 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 723932 T2009 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 723932 T2009 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 723933 T2009 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 723933 T2009 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 723934 T2009 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 723934 T2009 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 723934 T2009 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 723936 T2009 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 723936 T2009 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 723937 T2009 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:39739/solr
[junit4] 2> 723937 T2009 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 723938 T2009 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 723939 T2097 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1037c66 name:ZooKeeperConnection Watcher:127.0.0.1:39739 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 723940 T2009 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 723943 T2009 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 723945 T2099 oa
[...truncated too long message...]
er (id=90701388575670300-127.0.0.1:60021_-n_0000000012) starting
[junit4] 2> 779016 T2370 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 779017 T2242 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 779018 T2369 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 779022 T2369 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 779023 T2369 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:45495",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:45495_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":null,
[junit4] 2> "core_node_name":"core_node11"}
[junit4] 2> 779027 T2009 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4] 2> 779039 T2242 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 779079 T2009 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 60021
[junit4] 2> 779080 T2009 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=29238316
[junit4] 2> 779398 T2298 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 780081 T2009 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 780082 T2009 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 780097 T2009 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@130796e
[junit4] 2> 780099 T2009 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=7,autocommits=0,soft autocommit maxTime=1000ms,soft autocommits=5,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=65,cumulative_deletesById=28,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4] 2> 780099 T2009 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 780100 T2009 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 780100 T2009 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 780101 T2009 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 780102 T2009 oasc.CachingDirectoryFactory.close Closing StandardDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 780102 T2009 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty12/index.20131109073639088 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty12/index.20131109073639088;done=false>>]
[junit4] 2> 780103 T2009 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty12/index.20131109073639088
[junit4] 2> 780104 T2009 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty12 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty12;done=false>>]
[junit4] 2> 780105 T2009 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1383993355949/jetty12
[junit4] 2> 780106 T2369 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=90701388575670300-127.0.0.1:60021_-n_0000000012) am no longer a leader.
[junit4] 2> 780131 T2009 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4] 2> 780220 T2009 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> 780222 T2009 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:39739 39739
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 1> safe stop:
[junit4] 1> safe stop:
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.method=testDistribSearch -Dtests.seed=A3B40B43DAA5D33F -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ja -Dtests.timezone=America/Argentina/Jujuy -Dtests.file.encoding=UTF-8
[junit4] FAILURE 69.3s J1 | ChaosMonkeySafeLeaderTest.testDistribSearch <<<
[junit4] > Throwable #1: java.lang.AssertionError: shard2 is not consistent. Got 32 from http://127.0.0.1:57316/collection1lastClient and got 29 from http://127.0.0.1:45495/collection1
[junit4] > at __randomizedtesting.SeedInfo.seed([A3B40B43DAA5D33F:2252855BADFAB303]:0)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1151)
[junit4] > at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:135)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4] > at java.lang.Thread.run(Thread.java:662)
[junit4] 2> 780411 T2009 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 69321 T2008 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4] 2> 780505 T2224 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 781608 T2242 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Lucene45, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=ja, timezone=America/Argentina/Jujuy
[junit4] 2> NOTE: Linux 3.8.0-32-generic i386/Sun Microsystems Inc. 1.6.0_45 (32-bit)/cpus=8,threads=1,free=38943680,total=139354112
[junit4] 2> NOTE: All tests run in this JVM: [TestMultiCoreConfBootstrap, MultiTermTest, HdfsBasicDistributedZk2Test, IndexSchemaRuntimeFieldTest, TestAnalyzedSuggestions, DebugComponentTest, BadIndexSchemaTest, CachingDirectoryFactoryTest, TestCloudManagedSchemaAddField, TestShardHandlerFactory, TestSolrDeletionPolicy2, TestBinaryResponseWriter, SortByFunctionTest, InfoHandlerTest, XmlUpdateRequestHandlerTest, TermVectorComponentDistributedTest, DistanceFunctionTest, PreAnalyzedUpdateProcessorTest, TestRecovery, AddSchemaFieldsUpdateProcessorFactoryTest, TestIBSimilarityFactory, OpenExchangeRatesOrgProviderTest, RAMDirectoryFactoryTest, TestDefaultSimilarityFactory, TestWordDelimiterFilterFactory, SuggesterTSTTest, BlockCacheTest, DirectUpdateHandlerTest, TestZkChroot, TestCoreDiscovery, CurrencyFieldOpenExchangeTest, TestManagedSchemaFieldResource, SolrRequestParserTest, FileUtilsTest, TestCollationKeyRangeQueries, TestFuzzyAnalyzedSuggestions, HdfsCollectionsAPIDistributedZkTest, LeaderElectionIntegrationTest, TestAtomicUpdateErrorCases, BJQParserTest, TestNumberUtils, ZkNodePropsTest, TestNoOpRegenerator, PathHierarchyTokenizerFactoryTest, TestDynamicFieldResource, CurrencyFieldXmlFileTest, HdfsLockFactoryTest, TestXIncludeConfig, TestBinaryField, TestDynamicFieldCollectionResource, CollectionsAPIDistributedZkTest, TestSweetSpotSimilarityFactory, ShardSplitTest, SolrPluginUtilsTest, SolrIndexConfigTest, IndexBasedSpellCheckerTest, TestStressLucene, SuggesterWFSTTest, OutputWriterTest, TestUtils, TestFieldResource, TestCodecSupport, TestFastOutputStream, NotRequiredUniqueKeyTest, PreAnalyzedFieldTest, QueryResultKeyTest, SpellCheckComponentTest, TestReload, DeleteInactiveReplicaTest, TestLazyCores, DirectSolrSpellCheckerTest, DateFieldTest, TestCollationField, XsltUpdateRequestHandlerTest, TestPhraseSuggestions, ChaosMonkeySafeLeaderTest]
[junit4] Completed on J1 in 70.62s, 1 test, 1 failure <<< FAILURES!
[...truncated 539 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:428: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:408: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:483: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1275: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:911: There were test failures: 335 suites, 1475 tests, 1 failure, 35 ignored (6 assumptions)
Total time: 53 minutes 32 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.6.0_45 -client -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (32bit/ibm-j9-jdk6) - Build # 8145
- Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/8145/
Java: 32bit/ibm-j9-jdk6 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
1 tests failed.
FAILED: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
Expected content type application/octet-stream but got text/html;charset=ISO-8859-1. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 Can not find: /onenodecollectioncore/update</title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /onenodecollectioncore/update. Reason: <pre> Can not find: /onenodecollectioncore/update</pre></p> <hr /><i><small>Powered by Jetty://</small></i> </body> </html>
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected content type application/octet-stream but got text/html;charset=ISO-8859-1. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 Can not find: /onenodecollectioncore/update</title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /onenodecollectioncore/update. Reason:
<pre> Can not find: /onenodecollectioncore/update</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
</body>
</html>
at __randomizedtesting.SeedInfo.seed([DEA91EF7C6BA4BDB:5F4F90EFB1E52BE7]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:428)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:88)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:60)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
at java.lang.reflect.Method.invoke(Method.java:611)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:738)
Build Log:
[...truncated 9558 lines...]
[junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4] 2> 256962 T893 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 256965 T893 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1384003564319
[junit4] 2> 256967 T893 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 256967 T894 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 257067 T893 oasc.ZkTestServer.run start zk server on port:40231
[junit4] 2> 257069 T893 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 257079 T900 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@29a429a4 name:ZooKeeperConnection Watcher:127.0.0.1:40231 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 257080 T893 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 257080 T893 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 257088 T893 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 257090 T902 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6b5a6b5a name:ZooKeeperConnection Watcher:127.0.0.1:40231/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 257090 T893 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 257091 T893 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 257099 T893 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 257106 T893 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 257112 T893 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 257119 T893 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 257120 T893 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 257131 T893 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 257132 T893 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 257140 T893 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 257141 T893 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 257148 T893 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 257149 T893 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 257158 T893 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 257159 T893 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 257167 T893 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 257168 T893 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 257175 T893 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 257176 T893 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 257184 T893 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 257185 T893 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 257193 T893 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 257194 T893 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 257202 T893 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 257203 T893 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 257211 T893 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 257212 T893 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 257390 T893 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 257393 T893 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:36059
[junit4] 2> 257394 T893 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 257395 T893 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 257395 T893 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1384003564574
[junit4] 2> 257396 T893 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1384003564574/'
[junit4] 2> 257416 T893 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1384003564574/solr.xml
[junit4] 2> 257453 T893 oasc.CoreContainer.<init> New CoreContainer 1716414030
[junit4] 2> 257454 T893 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1384003564574/]
[junit4] 2> 257455 T893 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 257456 T893 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 257457 T893 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 257457 T893 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 257458 T893 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 257459 T893 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 257459 T893 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 257460 T893 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 257461 T893 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 257462 T893 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 257463 T893 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 257465 T893 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:40231/solr
[junit4] 2> 257466 T893 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 257467 T893 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 257471 T913 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@509a509a name:ZooKeeperConnection Watcher:127.0.0.1:40231 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 257472 T893 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 257481 T893 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 257483 T915 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16bb16bb name:ZooKeeperConnection Watcher:127.0.0.1:40231/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 257484 T893 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 257488 T893 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 257498 T893 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 257510 T893 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 257517 T893 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36059_
[junit4] 2> 257519 T893 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36059_
[junit4] 2> 257531 T893 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 257548 T893 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 257557 T893 oasc.Overseer.start Overseer (id=90702057593831427-127.0.0.1:36059_-n_0000000000) starting
[junit4] 2> 257568 T893 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 257604 T917 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 257606 T893 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 257615 T893 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 257621 T893 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 257631 T916 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 257634 T918 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 257634 T918 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 257637 T918 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 259152 T916 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 259157 T916 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:36059",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:36059_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 259158 T916 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 259160 T916 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 259182 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 259638 T918 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 259640 T918 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1384003564574/collection1
[junit4] 2> 259642 T918 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 259645 T918 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 259646 T918 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 259650 T918 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1384003564574/collection1/'
[junit4] 2> 259652 T918 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1384003564574/collection1/lib/classes/' to classloader
[junit4] 2> 259653 T918 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1384003564574/collection1/lib/README' to classloader
[junit4] 2> 259705 T918 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
[junit4] 2> 259749 T918 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 259752 T918 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 259759 T918 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 260154 T918 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 260155 T918 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 260155 T918 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 260161 T918 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 260164 T918 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 260220 T918 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 260236 T918 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 260244 T918 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 260250 T918 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 260251 T918 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 260252 T918 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 260257 T918 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 260258 T918 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 260259 T918 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 260259 T918 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1384003564574/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1384003564319/control/data/
[junit4] 2> 260260 T918 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c5f2c5f
[junit4] 2> 260261 T918 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1384003564319/control/data
[junit4] 2> 260262 T918 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1384003564319/control/data/index/
[junit4] 2> 260262 T918 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1384003564319/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 260263 T918 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1384003564319/control/data/index
[junit4] 2> 260263 T918 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=31, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=70.2421875, floorSegmentMB=0.501953125, forceMergeDeletesPctAllowed=19.206932032658152, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 260264 T918 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@20202020 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@16a516a5),segFN=segments_1,generation=1}
[junit4] 2> 260265 T918 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 260271 T918 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 260272 T918 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 260273 T918 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 260273 T918 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 260274 T918 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 260275 T918 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 260275 T918 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 260276 T918 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 260277 T918 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 260278 T918 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 260279 T918 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 260279 T918 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 260280 T918 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 260281 T918 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 260282 T918 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 260283 T918 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 260287 T918 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 260288 T918 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 260289 T918 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=25.3427734375, floorSegmentMB=0.23046875, forceMergeDeletesPctAllowed=10.508989664625695, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 260290 T918 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@20202020 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@16a516a5),segFN=segments_1,generation=1}
[junit4] 2> 260290 T918 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 260291 T918 oass.SolrIndexSearcher.<init> Opening Searcher@525a525a main
[junit4] 2> 260299 T919 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@525a525a main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 260304 T918 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 260305 T918 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36059 collection:control_collection shard:shard1
[junit4] 2> 260311 T918 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 260351 T918 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 260359 T918 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 260359 T918 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 260360 T918 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36059/collection1/
[junit4] 2> 260360 T918 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 260361 T918 oasc.SyncStrategy.syncToMe http://127.0.0.1:36059/collection1/ has no replicas
[junit4] 2> 260362 T918 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36059/collection1/ shard1
[junit4] 2> 260362 T918 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 260698 T916 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 260901 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 260941 T918 oasc.ZkController.register We are http://127.0.0.1:36059/collection1/ and leader is http://127.0.0.1:36059/collection1/
[junit4] 2> 260942 T918 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36059
[junit4] 2> 260942 T918 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 260943 T918 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 260943 T918 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 260950 T918 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 260955 T893 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 260955 T893 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 260963 T893 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 260966 T922 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@209d209d name:ZooKeeperConnection Watcher:127.0.0.1:40231/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 260966 T893 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 260972 T893 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 260986 T893 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 261163 T893 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 261165 T893 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:36262
[junit4] 2> 261166 T893 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 261167 T893 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 261168 T893 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1384003568340
[junit4] 2> 261169 T893 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1384003568340/'
[junit4] 2> 261180 T893 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1384003568340/solr.xml
[junit4] 2> 261214 T893 oasc.CoreContainer.<init> New CoreContainer 1948480547
[junit4] 2> 261215 T893 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1384003568340/]
[junit4] 2> 261216 T893 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 261217 T893 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 261218 T893 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 261219 T893 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 261219 T893 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 261220 T893 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 261221 T893 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 261221 T893 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 261222 T893 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 261224 T893 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 261224 T893 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 261226 T893 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:40231/solr
[junit4] 2> 261227 T893 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 261228 T893 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 261232 T933 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5fa45fa4 name:ZooKeeperConnection Watcher:127.0.0.1:40231 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 261234 T893 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 261244 T893 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 261586 T935 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@539a539a name:ZooKeeperConnection Watcher:127.0.0.1:40231/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 261587 T893 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 261612 T893 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 262432 T916 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 262435 T916 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:36059",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:36059_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 262452 T935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 262453 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 262454 T922 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 262626 T893 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36262_
[junit4] 2> 262629 T893 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36262_
[junit4] 2> 262640 T915 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 262640 T922 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 262643 T935 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 262657 T936 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 262658 T936 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 262661 T936 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 263982 T916 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 263984 T916 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:36262",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:36262_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 263985 T916 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 263986 T916 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 264070 T922 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 264071 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 264070 T935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 264661 T936 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 264662 T936 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1384003568340/collection1
[junit4] 2> 264663 T936 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 264665 T936 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 264666 T936 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 264679 T936 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1384003568340/collection1/'
[junit4] 2> 264682 T936 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1384003568340/collection1/lib/classes/' to classloader
[junit4] 2> 264683 T936 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1384003568340/collection1/lib/README' to classloader
[junit4] 2> 264732 T936 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
[junit4] 2> 264768 T936 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 264773 T936 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 264781 T936 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 265611 T936 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 265612 T936 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 265614 T936 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 265650 T936 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 265655 T936 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 265758 T936 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 265780 T936 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 265791 T936 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 265808 T936 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 265809 T936 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 265810 T936 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 265849 T936 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 265850 T936 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 265851 T936 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 265851 T936 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1384003568340/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1384003564319/jetty1/
[junit4] 2> 265852 T936 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c5f2c5f
[junit4] 2> 265854 T936 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1384003564319/jetty1
[junit4] 2> 265854 T936 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1384003564319/jetty1/index/
[junit4] 2> 265855 T936 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1384003564319/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 265855 T936 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1384003564319/jetty1/index
[junit4] 2> 265856 T936 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=31, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=70.2421875, floorSegmentMB=0.501953125, forceMergeDeletesPctAllowed=19.206932032658152, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 265864 T936 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@5bc25bc2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@34763476),segFN=segments_1,generation=1}
[junit4] 2> 265865 T936 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 265901 T936 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 265914 T936 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 265915 T936 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 265973 T936 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 265974 T936 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 265975 T936 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 265976 T936 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 265977 T936 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 265977 T936 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 265979 T936 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 265980 T936 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 265981 T936 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 265999 T936 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 266037 T936 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 266038 T936 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 266048 T936 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 266059 T936 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 266060 T936 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 266062 T936 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=25.3427734375, floorSegmentMB=0.23046875, forceMergeDeletesPctAllowed=10.508989664625695, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 266063 T936 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@5bc25bc2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@34763476),segFN=segments_1,generation=1}
[junit4] 2> 266064 T936 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 266065 T936 oass.SolrIndexSearcher.<init> Opening Searcher@748e748e main
[junit4] 2> 266104 T937 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@748e748e main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 266111 T936 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 266111 T936 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36262 collection:collection1 shard:shard1
[junit4] 2> 266137 T936 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 266214 T936 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 266248 T936 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 266249 T936 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 266250 T936 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36262/collection1/
[junit4] 2> 266250 T936 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 266251 T936 oasc.SyncStrategy.syncToMe http://127.0.0.1:36262/collection1/ has no replicas
[junit4] 2> 266252 T936 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36262/collection1/ shard1
[junit4] 2> 266252 T936 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 267101 T916 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 267178 T922 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 267178 T935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 267187 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 267364 T936 oasc.ZkController.register We are http://127.0.0.1:36262/collection1/ and leader is http://127.0.0.1:36262/collection1/
[junit4] 2> 267365 T936 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36262
[junit4] 2> 267365 T936 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 267366 T936 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 267367 T936 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 267378 T936 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 267384 T893 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 267385 T893 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 267860 T893 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 267863 T893 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:46407
[junit4] 2> 267864 T893 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 267865 T893 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 267865 T893 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1384003574740
[junit4] 2> 267866 T893 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1384003574740/'
[junit4] 2> 267883 T893 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1384003574740/solr.xml
[junit4] 2> 267957 T893 oasc.CoreContainer.<init> New CoreContainer 48956139
[junit4] 2> 267958 T893 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1384003574740/]
[junit4] 2> 267959 T893 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 267960 T893 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 267961 T893 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 267962 T893 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 267962 T893 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 267963 T893 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 267964 T893 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 267965 T893 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 268071 T893 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 268073 T893 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 268074 T893 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 268085 T893 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:40231/solr
[junit4] 2> 268118 T893 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 268119 T893 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 268129 T949 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9c509c5 name:ZooKeeperConnection Watcher:127.0.0.1:40231 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 268136 T893 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 268151 T893 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 268156 T951 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4ea34ea3 name:ZooKeeperConnection Watcher:127.0.0.1:40231/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 268156 T893 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 268237 T893 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 268905 T916 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 268908 T916 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:36262",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:36262_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 268978 T951 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 268978 T935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 268990 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 268990 T922 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 269268 T893 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46407_
[junit4] 2> 269272 T893 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46407_
[junit4] 2> 269286 T935 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 269287 T922 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 269289 T951 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 269290 T915 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 269368 T952 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 269398 T952 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 269415 T952 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 270513 T916 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 270517 T916 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:46407",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:46407_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 270518 T916 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 270518 T916 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 270542 T951 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 270543 T935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 270544 T922 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 270546 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 271420 T952 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 271421 T952 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1384003574740/collection1
[junit4] 2> 271422 T952 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 271425 T952 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 271425 T952 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 271430 T952 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1384003574740/collection1/'
[junit4] 2> 271432 T952 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1384003574740/collection1/lib/classes/' to classloader
[junit4] 2> 271433 T952 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1384003574740/collection1/lib/README' to classloader
[junit4] 2> 271508 T952 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
[junit4] 2> 271667 T952 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 271678 T952 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 271690 T952 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 272615 T952 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 272616 T952 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 272617 T952 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 272624 T952 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 272652 T952 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 272785 T952 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 272811 T952 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 272845 T952 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 272867 T952 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 272868 T952 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 272869 T952 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 272876 T952 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 272876 T952 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 272877 T952 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 272878 T952 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1384003574740/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1384003564319/jetty2/
[junit4] 2> 272879 T952 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c5f2c5f
[junit4] 2> 272880 T952 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1384003564319/jetty2
[junit4] 2> 272881 T952 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1384003564319/jetty2/index/
[junit4] 2> 272938 T952 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1384003564319/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 272939 T952 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1384003564319/jetty2/index
[junit4] 2> 272939 T952 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=31, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=70.2421875, floorSegmentMB=0.501953125, forceMergeDeletesPctAllowed=19.206932032658152, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 272943 T952 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@74f674f6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@41134113),segFN=segments_1,generation=1}
[junit4] 2> 272944 T952 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 272955 T952 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 272955 T952 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 272958 T952 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 272961 T952 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 272961 T952 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 272962 T952 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 272963 T952 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 272966 T952 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 272972 T952 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 272979 T952 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 272981 T952 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 272982 T952 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 272983 T952 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 272992 T952 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 272993 T952 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 272999 T952 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 273004 T952 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 273005 T952 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 273007 T952 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=25.3427734375, floorSegmentMB=0.23046875, forceMergeDeletesPctAllowed=10.508989664625695, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 273008 T952 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@74f674f6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@41134113),segFN=segments_1,generation=1}
[junit4] 2> 273008 T952 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 273009 T952 oass.SolrIndexSearcher.<init> Opening Searcher@2a132a13 main
[junit4] 2> 273018 T953 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2a132a13 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 273019 T952 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 273020 T952 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:46407 collection:collection1 shard:shard2
[junit4] 2> 273027 T952 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 273060 T952 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 273092 T952 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 273093 T952 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 273093 T952 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:46407/collection1/
[junit4] 2> 273094 T952 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 273095 T952 oasc.SyncStrategy.syncToMe http://127.0.0.1:46407/collection1/ has no replicas
[junit4] 2> 273095 T952 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:46407/collection1/ shard2
[junit4] 2> 273096 T952 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 273630 T916 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 273710 T951 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 273711 T935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 273711 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 273710 T922 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 273722 T952 oasc.ZkController.register We are http://127.0.0.1:46407/collection1/ and leader is http://127.0.0.1:46407/collection1/
[junit4] 2> 273723 T952 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46407
[junit4] 2> 273723 T952 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 273724 T952 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 273725 T952 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 273735 T952 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 273739 T893 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 273740 T893 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 274148 T893 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 274161 T893 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59039
[junit4] 2> 274163 T893 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 274165 T893 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 274166 T893 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1384003581096
[junit4] 2> 274167 T893 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1384003581096/'
[junit4] 2> 274223 T893 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1384003581096/solr.xml
[junit4] 2> 274427 T893 oasc.CoreContainer.<init> New CoreContainer 1284066441
[junit4] 2> 274428 T893 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1384003581096/]
[junit4] 2> 274430 T893 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 274431 T893 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 274432 T893 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 274433 T893 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 274434 T893 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 274435 T893 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 274438 T893 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 274464 T893 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 274465 T893 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 274487 T893 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 274496 T893 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 274499 T893 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:40231/solr
[junit4] 2> 274500 T893 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 274506 T893 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 274523 T965 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cc01cc0 name:ZooKeeperConnection Watcher:127.0.0.1:40231 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 274523 T893 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 274554 T893 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 274585 T967 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6580658 name:ZooKeeperConnection Watcher:127.0.0.1:40231/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 274585 T893 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 274642 T893 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 275255 T916 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 275259 T916 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:46407",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:46407_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 275289 T935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 275290 T967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 275291 T951 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 275302 T922 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 275305 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 275669 T893 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59039_
[junit4] 2> 275672 T893 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59039_
[junit4] 2> 275684 T922 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 275686 T967 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 275686 T935 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 275687 T915 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 275689 T951 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 275715 T968 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 275722 T968 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 275731 T968 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 276849 T916 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 276853 T916 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:59039",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:59039_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 276854 T916 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 276855 T916 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 276881 T967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 276881 T935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 276881 T922 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 276882 T951 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 276883 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 277732 T968 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 277733 T968 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1384003581096/collection1
[junit4] 2> 277733 T968 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 277736 T968 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 277736 T968 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 277741 T968 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1384003581096/collection1/'
[junit4] 2> 277743 T968 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1384003581096/collection1/lib/classes/' to classloader
[junit4] 2> 277744 T968 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1384003581096/collection1/lib/README' to classloader
[junit4] 2> 277867 T968 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
[junit4] 2> 278015 T968 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 278026 T968 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 278037 T968 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 279569 T968 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 279570 T968 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 279607 T968 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 279640 T968 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 279647 T968 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 279824 T968 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 279843 T968 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 279858 T968 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 279892 T968 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 279893 T968 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 279893 T968 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 279909 T968 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 279910 T968 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 279921 T968 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 279922 T968 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1384003581096/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1384003564319/jetty3/
[junit4] 2> 279922 T968 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c5f2c5f
[junit4] 2> 279928 T968 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1384003564319/jetty3
[junit4] 2> 279930 T968 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1384003564319/jetty3/index/
[junit4] 2> 279930 T968 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1384003564319/jetty3/index' doesn't exist. Creating new index...
[junit4] 2> 279933 T968 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1384003564319/jetty3/index
[junit4] 2> 279934 T968 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=31, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=70.2421875, floorSegmentMB=0.501953125, forceMergeDeletesPctAllowed=19.206932032658152, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 279939 T968 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2f022f02 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1e161e16),segFN=segments_1,generation=1}
[junit4] 2> 279940 T968 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 279952 T968 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 279953 T968 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 279954 T968 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 279955 T968 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 279955 T968 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 279956 T968 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 279957 T968 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 279958 T968 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 279958 T968 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 279960 T968 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 279961 T968 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 279962 T968 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 279963 T968 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 279964 T968 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 279991 T968 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 279998 T968 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 280002 T968 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 280003 T968 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 280029 T968 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=25.3427734375, floorSegmentMB=0.23046875, forceMergeDeletesPctAllowed=10.508989664625695, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 280032 T968 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2f022f02 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1e161e16),segFN=segments_1,generation=1}
[junit4] 2> 280033 T968 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2800
[...truncated too long message...]
"control_collection":{
[junit4] 1> "shards":{"shard1":{
[junit4] 1> "range":"80000000-7fffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{"core_node1":{
[junit4] 1> "state":"active",
[junit4] 1> "base_url":"http://127.0.0.1:36059",
[junit4] 1> "core":"collection1",
[junit4] 1> "node_name":"127.0.0.1:36059_",
[junit4] 1> "leader":"true"}}}},
[junit4] 1> "maxShardsPerNode":"1",
[junit4] 1> "router":{"name":"compositeId"},
[junit4] 1> "autoCreated":"true",
[junit4] 1> "replicationFactor":"1"},
[junit4] 1> "onenodecollection":{
[junit4] 1> "shards":{"shard1":{
[junit4] 1> "range":"80000000-7fffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{"core_node1":{
[junit4] 1> "state":"active",
[junit4] 1> "base_url":"http://127.0.0.1:36262",
[junit4] 1> "core":"onenodecollectioncore",
[junit4] 1> "roles":"none",
[junit4] 1> "node_name":"127.0.0.1:36262_",
[junit4] 1> "leader":"true"}}}},
[junit4] 1> "maxShardsPerNode":"1",
[junit4] 1> "autoCreated":"true",
[junit4] 1> "router":{"name":"compositeId"},
[junit4] 1> "replicationFactor":"1"},
[junit4] 1> "collection1":{
[junit4] 1> "shards":{
[junit4] 1> "shard1":{
[junit4] 1> "range":"80000000-ffffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node1":{
[junit4] 1> "state":"active",
[junit4] 1> "base_url":"http://127.0.0.1:36262",
[junit4] 1> "core":"collection1",
[junit4] 1> "node_name":"127.0.0.1:36262_",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node3":{
[junit4] 1> "state":"active",
[junit4] 1> "base_url":"http://127.0.0.1:59039",
[junit4] 1> "core":"collection1",
[junit4] 1> "node_name":"127.0.0.1:59039_"}}},
[junit4] 1> "shard2":{
[junit4] 1> "range":"0-7fffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node2":{
[junit4] 1> "state":"active",
[junit4] 1> "base_url":"http://127.0.0.1:46407",
[junit4] 1> "core":"collection1",
[junit4] 1> "node_name":"127.0.0.1:46407_",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node4":{
[junit4] 1> "state":"active",
[junit4] 1> "base_url":"http://127.0.0.1:34384",
[junit4] 1> "core":"collection1",
[junit4] 1> "node_name":"127.0.0.1:34384_"}}}},
[junit4] 1> "maxShardsPerNode":"1",
[junit4] 1> "autoCreated":"true",
[junit4] 1> "router":{"name":"compositeId"},
[junit4] 1> "replicationFactor":"1"}}
[junit4] 1> /zookeeper (1)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1>
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=DEA91EF7C6BA4BDB -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sr -Dtests.timezone=America/Phoenix -Dtests.file.encoding=UTF-8
[junit4] ERROR 43.9s J1 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected content type application/octet-stream but got text/html;charset=ISO-8859-1. <html>
[junit4] > <head>
[junit4] > <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
[junit4] > <title>Error 404 Can not find: /onenodecollectioncore/update</title>
[junit4] > </head>
[junit4] > <body>
[junit4] > <h2>HTTP ERROR: 404</h2>
[junit4] > <p>Problem accessing /onenodecollectioncore/update. Reason:
[junit4] > <pre> Can not find: /onenodecollectioncore/update</pre></p>
[junit4] > <hr /><i><small>Powered by Jetty://</small></i>
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] > </body>
[junit4] > </html>
[junit4] > at __randomizedtesting.SeedInfo.seed([DEA91EF7C6BA4BDB:5F4F90EFB1E52BE7]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:428)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4] > at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
[junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:88)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4] > at java.lang.Thread.run(Thread.java:738)
[junit4] 2> 300877 T893 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 43960 T892 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> 301966 T988 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Lucene40, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=sr, timezone=America/Phoenix
[junit4] 2> NOTE: Linux 3.8.0-32-generic x86/IBM Corporation 1.6.0 (32-bit)/cpus=8,threads=2,free=6660008,total=43558400
[junit4] 2> NOTE: All tests run in this JVM: [HdfsCollectionsAPIDistributedZkTest, OpenCloseCoreStressTest, TestUtils, HdfsBasicDistributedZk2Test, TestUpdate, LeaderElectionIntegrationTest, TestSolrCoreProperties, TermVectorComponentDistributedTest, TestSchemaSimilarityResource, TestCoreDiscovery, StressHdfsTest, SolrXmlInZkTest, TestShardHandlerFactory, DocValuesMultiTest, FileUtilsTest, IndexSchemaRuntimeFieldTest, MinimalSchemaTest, HighlighterTest, TestUniqueKeyFieldResource, DocValuesMissingTest, SolrRequestParserTest, ParsingFieldUpdateProcessorsTest, TestSolrDeletionPolicy2, TestSolrXmlPersistence, JSONWriterTest, TestReload, SpellCheckCollatorTest, TimeZoneUtilsTest, TestPhraseSuggestions, NumericFieldsTest, TestSolrQueryParserResource, TestRangeQuery, SolrCmdDistributorTest, PrimUtilsTest, TestHashPartitioner, BadIndexSchemaTest, TestSchemaVersionResource, TestLazyCores, TestSolr4Spatial, BasicDistributedZk2Test]
[junit4] Completed on J1 in 45.24s, 1 test, 1 error <<< FAILURES!
[...truncated 796 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:428: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:421: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:483: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1275: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:911: There were test failures: 335 suites, 1475 tests, 1 error, 35 ignored (6 assumptions)
Total time: 59 minutes 57 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/ibm-j9-jdk6 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.7.0_45) - Build # 8144
- Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/8144/
Java: 32bit/jdk1.7.0_45 -server -XX:+UseG1GC
4 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.DeleteReplicaTest
Error Message:
ERROR: SolrZkClient opens=15 closes=14
Stack Trace:
java.lang.AssertionError: ERROR: SolrZkClient opens=15 closes=14
at __randomizedtesting.SeedInfo.seed([77FAE56CCE485EF0]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:343)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:135)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.DeleteReplicaTest
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.DeleteReplicaTest: 1) Thread[id=278, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[77FAE56CCE485EF0]-EventThread, state=WAITING, group=TGRP-DeleteReplicaTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 2) Thread[id=277, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[77FAE56CCE485EF0]-SendThread(localhost.localdomain:46343), state=TIMED_WAITING, group=TGRP-DeleteReplicaTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.DeleteReplicaTest:
1) Thread[id=278, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[77FAE56CCE485EF0]-EventThread, state=WAITING, group=TGRP-DeleteReplicaTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
2) Thread[id=277, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[77FAE56CCE485EF0]-SendThread(localhost.localdomain:46343), state=TIMED_WAITING, group=TGRP-DeleteReplicaTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
at __randomizedtesting.SeedInfo.seed([77FAE56CCE485EF0]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.DeleteReplicaTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=277, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[77FAE56CCE485EF0]-SendThread(localhost.localdomain:46343), state=TIMED_WAITING, group=TGRP-DeleteReplicaTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=277, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[77FAE56CCE485EF0]-SendThread(localhost.localdomain:46343), state=TIMED_WAITING, group=TGRP-DeleteReplicaTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
at __randomizedtesting.SeedInfo.seed([77FAE56CCE485EF0]:0)
REGRESSION: org.apache.solr.cloud.DeleteReplicaTest.testDistribSearch
Error Message:
Invalid replica : core_node2 in shard/collection : shard1/delLiveColl
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Invalid replica : core_node2 in shard/collection : shard1/delLiveColl
at __randomizedtesting.SeedInfo.seed([77FAE56CCE485EF0:F61C6B74B9173ECC]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:464)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:268)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:640)
at org.apache.solr.cloud.DeleteReplicaTest.removeAndWaitForReplicaGone(DeleteReplicaTest.java:149)
at org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:135)
at org.apache.solr.cloud.DeleteReplicaTest.doTest(DeleteReplicaTest.java:115)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Build Log:
[...truncated 10000 lines...]
[junit4] Suite: org.apache.solr.cloud.DeleteReplicaTest
[junit4] 2> 20540 T190 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /pr_a/os
[junit4] 2> 20548 T190 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-DeleteReplicaTest-1383998148594
[junit4] 2> 20549 T190 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 20549 T191 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 20650 T190 oasc.ZkTestServer.run start zk server on port:46343
[junit4] 2> 20651 T190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 20679 T197 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11d1e67 name:ZooKeeperConnection Watcher:127.0.0.1:46343 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 20679 T190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 20680 T190 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 20685 T190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 20686 T199 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8b63b8 name:ZooKeeperConnection Watcher:127.0.0.1:46343/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 20687 T190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 20687 T190 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 20692 T190 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 20696 T190 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 20698 T190 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 20702 T190 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 20709 T190 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 20715 T190 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 20715 T190 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 20719 T190 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 20720 T190 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 20723 T190 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 20723 T190 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 20727 T190 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 20727 T190 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 20730 T190 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 20731 T190 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 20734 T190 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 20734 T190 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 20738 T190 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 20739 T190 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 20742 T190 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 20743 T190 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 20747 T190 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 20747 T190 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 20752 T190 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 20753 T190 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 20955 T190 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 21035 T190 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55094
[junit4] 2> 21049 T190 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 21050 T190 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 21051 T190 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.DeleteReplicaTest-controljetty-1383998148803
[junit4] 2> 21051 T190 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.DeleteReplicaTest-controljetty-1383998148803/'
[junit4] 2> 21064 T190 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-controljetty-1383998148803/solr.xml
[junit4] 2> 21106 T190 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 21107 T190 oasc.CoreContainer.<init> New CoreContainer 1277448
[junit4] 2> 21108 T190 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.DeleteReplicaTest-controljetty-1383998148803/]
[junit4] 2> 21127 T190 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 21128 T190 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 21129 T190 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 21129 T190 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 21130 T190 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 21131 T190 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 21131 T190 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 21132 T190 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 21133 T190 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 21135 T190 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 21136 T190 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 21136 T190 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46343/solr
[junit4] 2> 21143 T190 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 21144 T190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 21147 T211 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8d0880 name:ZooKeeperConnection Watcher:127.0.0.1:46343 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 21148 T190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 21153 T190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 21155 T213 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@976197 name:ZooKeeperConnection Watcher:127.0.0.1:46343/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 21155 T190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 21157 T190 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 21161 T190 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 21165 T190 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 21167 T190 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55094_pr_a%2Fos
[junit4] 2> 21168 T190 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55094_pr_a%2Fos
[junit4] 2> 21172 T190 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 21178 T190 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 21181 T190 oasc.Overseer.start Overseer (id=90701702666452995-127.0.0.1:55094_pr_a%2Fos-n_0000000000) starting
[junit4] 2> 21191 T190 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 21202 T215 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 21203 T190 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 21206 T190 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 21209 T190 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 21216 T214 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 21220 T190 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-controljetty-1383998148803
[junit4] 2> 21224 T190 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-controljetty-1383998148803/conf/
[junit4] 2> 21246 T190 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 21247 T190 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 21247 T190 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 21272 T190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 21273 T218 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@307b0e name:ZooKeeperConnection Watcher:127.0.0.1:46343/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 21274 T190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 21275 T190 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 21280 T190 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 21350 T190 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 21353 T190 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56228
[junit4] 2> 21354 T190 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 21354 T190 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 21355 T190 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.DeleteReplicaTest-jetty1-1383998149325
[junit4] 2> 21355 T190 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.DeleteReplicaTest-jetty1-1383998149325/'
[junit4] 2> 21367 T190 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty1-1383998149325/solr.xml
[junit4] 2> 21418 T190 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 21418 T190 oasc.CoreContainer.<init> New CoreContainer 6764690
[junit4] 2> 21419 T190 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.DeleteReplicaTest-jetty1-1383998149325/]
[junit4] 2> 21420 T190 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 21420 T190 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 21421 T190 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 21421 T190 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 21421 T190 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 21422 T190 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 21422 T190 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 21423 T190 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 21423 T190 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 21425 T190 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 21425 T190 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 21425 T190 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46343/solr
[junit4] 2> 21426 T190 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 21427 T190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 21428 T229 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c85f78 name:ZooKeeperConnection Watcher:127.0.0.1:46343 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 21429 T190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 21432 T190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 21433 T231 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@139a9a9 name:ZooKeeperConnection Watcher:127.0.0.1:46343/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 21434 T190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 21438 T190 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 22442 T190 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56228_pr_a%2Fos
[junit4] 2> 22444 T190 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56228_pr_a%2Fos
[junit4] 2> 22449 T231 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 22449 T218 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 22449 T213 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 22457 T190 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty1-1383998149325
[junit4] 2> 22458 T190 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty1-1383998149325/conf/
[junit4] 2> 22479 T190 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 22480 T190 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 22481 T190 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 22559 T190 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 22565 T190 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:34754
[junit4] 2> 22566 T190 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 22567 T190 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 22568 T190 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty2-1383998150527
[junit4] 2> 22568 T190 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty2-1383998150527/'
[junit4] 2> 22589 T190 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty2-1383998150527/solr.xml
[junit4] 2> 22660 T190 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 22661 T190 oasc.CoreContainer.<init> New CoreContainer 5151974
[junit4] 2> 22661 T190 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty2-1383998150527/]
[junit4] 2> 22663 T190 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 22663 T190 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 22664 T190 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 22664 T190 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 22664 T190 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 22665 T190 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 22665 T190 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 22666 T190 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 22666 T190 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 22667 T190 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 22668 T190 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 22668 T190 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46343/solr
[junit4] 2> 22669 T190 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 22670 T190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 22672 T243 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8627c3 name:ZooKeeperConnection Watcher:127.0.0.1:46343 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 22672 T190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 22675 T190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 22677 T245 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ab5071 name:ZooKeeperConnection Watcher:127.0.0.1:46343/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 22677 T190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 22682 T190 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 23686 T190 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34754_pr_a%2Fos
[junit4] 2> 23710 T190 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34754_pr_a%2Fos
[junit4] 2> 23714 T213 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 23714 T218 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 23715 T245 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 23715 T231 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 23726 T190 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty2-1383998150527
[junit4] 2> 23728 T190 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty2-1383998150527/conf/
[junit4] 2> 23778 T190 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 23780 T190 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 23780 T190 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 23860 T190 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 23863 T190 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59683
[junit4] 2> 23864 T190 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 23865 T190 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 23865 T190 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.DeleteReplicaTest-jetty3-1383998151826
[junit4] 2> 23866 T190 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.DeleteReplicaTest-jetty3-1383998151826/'
[junit4] 2> 23877 T190 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty3-1383998151826/solr.xml
[junit4] 2> 23941 T190 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 23942 T190 oasc.CoreContainer.<init> New CoreContainer 16479944
[junit4] 2> 23942 T190 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.DeleteReplicaTest-jetty3-1383998151826/]
[junit4] 2> 23943 T190 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 23944 T190 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 23944 T190 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 23945 T190 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 23945 T190 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 23946 T190 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 23946 T190 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 23946 T190 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 23947 T190 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 23948 T190 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 23949 T190 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 23949 T190 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46343/solr
[junit4] 2> 23949 T190 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 23950 T190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 24227 T257 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c9ea00 name:ZooKeeperConnection Watcher:127.0.0.1:46343 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 24228 T190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 24241 T190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 24243 T259 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d23318 name:ZooKeeperConnection Watcher:127.0.0.1:46343/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 24243 T190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 24248 T190 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 25253 T190 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59683_pr_a%2Fos
[junit4] 2> 25260 T190 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59683_pr_a%2Fos
[junit4] 2> 25264 T245 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 25265 T231 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 25264 T213 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 25265 T259 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 25273 T218 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 25279 T190 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty3-1383998151826
[junit4] 2> 25281 T190 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty3-1383998151826/conf/
[junit4] 2> 25305 T190 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 25306 T190 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 25306 T190 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 25377 T190 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 25379 T190 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53833
[junit4] 2> 25380 T190 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 25380 T190 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 25381 T190 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty4-1383998153352
[junit4] 2> 25381 T190 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty4-1383998153352/'
[junit4] 2> 25393 T190 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty4-1383998153352/solr.xml
[junit4] 2> 25446 T190 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 25447 T190 oasc.CoreContainer.<init> New CoreContainer 750115
[junit4] 2> 25447 T190 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty4-1383998153352/]
[junit4] 2> 25449 T190 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 25449 T190 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 25449 T190 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 25450 T190 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 25450 T190 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 25450 T190 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 25451 T190 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 25451 T190 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 25452 T190 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 25453 T190 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 25453 T190 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 25454 T190 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46343/solr
[junit4] 2> 25454 T190 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 25455 T190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 25457 T271 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1175e57 name:ZooKeeperConnection Watcher:127.0.0.1:46343 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 25458 T190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 25461 T190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 25462 T273 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@185c077 name:ZooKeeperConnection Watcher:127.0.0.1:46343/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 25463 T190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 25467 T190 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 26471 T190 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53833_pr_a%2Fos
[junit4] 2> 26473 T190 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53833_pr_a%2Fos
[junit4] 2> 26477 T231 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 26478 T213 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 26478 T259 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 26478 T273 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 26478 T245 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 26478 T218 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 26485 T190 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty4-1383998153352
[junit4] 2> 26487 T190 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty4-1383998153352/conf/
[junit4] 2> 26536 T190 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 26537 T190 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 26537 T190 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 26540 T190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 26542 T276 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c7a8f3 name:ZooKeeperConnection Watcher:127.0.0.1:46343/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 26542 T190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 26544 T190 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 26552 T190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 26554 T278 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14131da name:ZooKeeperConnection Watcher:127.0.0.1:46343/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 26554 T190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 26556 T190 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 26845 T240 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&maxShardsPerNode=2&name=delLiveColl&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4] 2> 26848 T213 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 26853 T215 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"delLiveColl",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2"}
[junit4] 2> 26855 T215 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"delLiveColl",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2"}
[junit4] 2> 27234 T214 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 27236 T214 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: delLiveColl
[junit4] 2> 27236 T214 oasc.Overseer$ClusterStateUpdater.createCollection Create collection delLiveColl with shards [shard1, shard2]
[junit4] 2> 27288 T273 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 27289 T213 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 27289 T278 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 27289 T245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 27289 T218 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 27289 T231 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 27289 T259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 27289 T276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 27362 T215 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2] , repFactor : 2
[junit4] 2> 27363 T215 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard1_replica1 as part of slice shard1 of collection delLiveColl on 127.0.0.1:34754_pr_a%2Fos
[junit4] 2> 27369 T215 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard1_replica2 as part of slice shard1 of collection delLiveColl on 127.0.0.1:55094_pr_a%2Fos
[junit4] 2> 27370 T215 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard2_replica1 as part of slice shard2 of collection delLiveColl on 127.0.0.1:56228_pr_a%2Fos
[junit4] 2> 27371 T215 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard2_replica2 as part of slice shard2 of collection delLiveColl on 127.0.0.1:53833_pr_a%2Fos
[junit4] 2> 27390 T239 oasc.ZkController.publish publishing core=delLiveColl_shard1_replica1 state=down
[junit4] 2> 27390 T208 oasc.ZkController.publish publishing core=delLiveColl_shard1_replica2 state=down
[junit4] 2> 27390 T267 oasc.ZkController.publish publishing core=delLiveColl_shard2_replica2 state=down
[junit4] 2> 27390 T225 oasc.ZkController.publish publishing core=delLiveColl_shard2_replica1 state=down
[junit4] 2> 27392 T239 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 27392 T267 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 27392 T208 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 27393 T225 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 28797 T214 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 28799 T214 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:34754/pr_a/os",
[junit4] 2> "core":"delLiveColl_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:34754_pr_a%2Fos",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 28807 T214 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:55094/pr_a/os",
[junit4] 2> "core":"delLiveColl_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55094_pr_a%2Fos",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 28813 T214 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:53833/pr_a/os",
[junit4] 2> "core":"delLiveColl_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53833_pr_a%2Fos",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 28819 T214 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:56228/pr_a/os",
[junit4] 2> "core":"delLiveColl_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56228_pr_a%2Fos",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 28825 T231 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 28825 T245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 28825 T218 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 28825 T276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 28825 T259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 28825 T278 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 28825 T273 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 28826 T213 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 29393 T239 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard1_replica1
[junit4] 2> 29393 T267 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard2_replica2
[junit4] 2> 29394 T208 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard1_replica2
[junit4] 2> 29394 T225 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard2_replica1
[junit4] 2> 29398 T239 oasc.CoreContainer.create Creating SolrCore 'delLiveColl_shard1_replica1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty2-1383998150527/delLiveColl_shard1_replica1
[junit4] 2> 29399 T239 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
[junit4] 2> 29398 T267 oasc.CoreContainer.create Creating SolrCore 'delLiveColl_shard2_replica2' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty4-1383998153352/delLiveColl_shard2_replica2
[junit4] 2> 29400 T267 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
[junit4] 2> 29400 T239 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:delLiveColl
[junit4] 2> 29401 T267 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:delLiveColl
[junit4] 2> 29401 T267 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 29398 T225 oasc.CoreContainer.create Creating SolrCore 'delLiveColl_shard2_replica1' using instanceDir: ./org.apache.solr.cloud.DeleteReplicaTest-jetty1-1383998149325/delLiveColl_shard2_replica1
[junit4] 2> 29402 T225 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
[junit4] 2> 29401 T239 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 29400 T208 oasc.CoreContainer.create Creating SolrCore 'delLiveColl_shard1_replica2' using instanceDir: ./org.apache.solr.cloud.DeleteReplicaTest-controljetty-1383998148803/delLiveColl_shard1_replica2
[junit4] 2> 29403 T225 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:delLiveColl
[junit4] 2> 29404 T225 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 29403 T267 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 29405 T267 oascc.SolrZkClient.makePath makePath: /collections/delLiveColl
[junit4] 2> 29405 T239 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 29404 T208 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
[junit4] 2> 29407 T208 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:delLiveColl
[junit4] 2> 29408 T208 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 29406 T239 oascc.SolrZkClient.makePath makePath: /collections/delLiveColl
[junit4] 2> 29406 T225 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 29409 T225 oascc.SolrZkClient.makePath makePath: /collections/delLiveColl
[junit4] 2> 29410 T208 oascc.SolrZkClient.makePath makePath: /collections/delLiveColl
[junit4] 2> 29415 T208 oasc.ZkController.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 29416 T225 oasc.ZkController.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 29417 T267 oasc.ZkController.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 29421 T225 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.DeleteReplicaTest-jetty1-1383998149325/delLiveColl_shard2_replica1/'
[junit4] 2> 29422 T267 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty4-1383998153352/delLiveColl_shard2_replica2/'
[junit4] 2> 29422 T208 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.DeleteReplicaTest-controljetty-1383998148803/delLiveColl_shard1_replica2/'
[junit4] 2> 29423 T239 oasc.ZkController.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 29425 T239 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty2-1383998150527/delLiveColl_shard1_replica1/'
[junit4] 2> 29635 T208 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
[junit4] 2> 29694 T225 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
[junit4] 2> 29706 T267 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
[junit4] 2> 29707 T239 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
[junit4] 2> 29886 T225 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 29903 T225 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 29954 T208 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 29966 T267 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 29972 T267 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 29973 T239 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 29972 T208 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 29992 T239 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 30026 T225 oass.IndexSchema.readSchema [delLiveColl_shard2_replica1] Schema name=test
[junit4] 2> 30105 T267 oass.IndexSchema.readSchema [delLiveColl_shard2_replica2] Schema name=test
[junit4] 2> 30132 T208 oass.IndexSchema.readSchema [delLiveColl_shard1_replica2] Schema name=test
[junit4] 2> 30209 T239 oass.IndexSchema.readSchema [delLiveColl_shard1_replica1] Schema name=test
[junit4] 2> 31720 T225 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 31788 T225 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 31791 T225 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 31819 T225 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 31859 T225 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 31932 T225 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 31966 T208 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 31967 T208 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 31969 T208 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 31985 T267 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 31985 T267 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 31992 T225 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 32005 T225 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 32005 T267 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 32011 T208 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 32017 T208 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 32028 T225 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 32029 T225 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 32030 T225 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 32032 T225 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 32032 T225 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 32033 T225 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 32033 T267 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 32034 T225 oasc.SolrCore.<init> [delLiveColl_shard2_replica1] Opening new SolrCore at ./org.apache.solr.cloud.DeleteReplicaTest-jetty1-1383998149325/delLiveColl_shard2_replica1/, dataDir=./org.apache.solr.cloud.DeleteReplicaTest-jetty1-1383998149325/delLiveColl_shard2_replica1/data/
[junit4] 2> 32054 T267 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 32058 T225 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12e8306
[junit4] 2> 32054 T239 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 32080 T239 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 32083 T239 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 32097 T225 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.DeleteReplicaTest-jetty1-1383998149325/delLiveColl_shard2_replica1/data
[junit4] 2> 32098 T225 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.DeleteReplicaTest-jetty1-1383998149325/delLiveColl_shard2_replica1/data/index/
[junit4] 2> 32099 T225 oasc.SolrCore.initIndex WARN [delLiveColl_shard2_replica1] Solr index directory './org.apache.solr.cloud.DeleteReplicaTest-jetty1-1383998149325/delLiveColl_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 32101 T225 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.DeleteReplicaTest-jetty1-1383998149325/delLiveColl_shard2_replica1/data/index
[junit4] 2> 32102 T225 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=23, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5966174100960888]
[junit4] 2> 32103 T225 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@152a53e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1824e70),segFN=segments_1,generation=1}
[junit4] 2> 32103 T225 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 32113 T225 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 32128 T239 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 32128 T225 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 32129 T225 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 32130 T225 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 32130 T225 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 32131 T225 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 32132 T225 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 32133 T225 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 32133 T225 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 32134 T225 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 32135 T208 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 32136 T225 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 32136 T225 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 32137 T225 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 32138 T225 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 32139 T225 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 32143 T208 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 32143 T225 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 32144 T239 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 32148 T225 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 32149 T225 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 32150 T267 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 32150 T225 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=17, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=65.19921875, floorSegmentMB=0.9140625, forceMergeDeletesPctAllowed=26.454089368367512, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 32152 T225 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@152a53e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1824e70),segFN=segments_1,generation=1}
[junit4] 2> 32152 T225 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 32153 T225 oass.SolrIndexSearcher.<init> Opening Searcher@1ddb03e main
[junit4] 2> 32153 T208 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 32159 T208 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 32161 T208 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 32162 T208 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 32165 T283 oasc.SolrCore.registerSearcher [delLiveColl_shard2_replica1] Registered new searcher Searcher@1ddb03e main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 32166 T208 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 32167 T208 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 32169 T208 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 32171 T208 oasc.SolrCore.<init> [delLiveColl_shard1_replica2] Opening new SolrCore at ./org.apache.solr.cloud.DeleteReplicaTest-controljetty-1383998148803/delLiveColl_shard1_replica2/, dataDir=./org.apache.solr.cloud.DeleteReplicaTest-controljetty-1383998148803/delLiveColl_shard1_replica2/data/
[junit4] 2> 32171 T208 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12e8306
[junit4] 2> 32168 T225 oasc.CoreContainer.registerCore registering core: delLiveColl_shard2_replica1
[junit4] 2> 32173 T225 oasc.ZkController.register Register replica - core:delLiveColl_shard2_replica1 address:http://127.0.0.1:56228/pr_a/os collection:delLiveColl shard:shard2
[junit4] 2> 32174 T208 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.DeleteReplicaTest-controljetty-1383998148803/delLiveColl_shard1_replica2/data
[junit4] 2> 32175 T208 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.DeleteReplicaTest-controljetty-1383998148803/delLiveColl_shard1_replica2/data/index/
[junit4] 2> 32176 T208 oasc.SolrCore.initIndex WARN [delLiveColl_shard1_replica2] Solr index directory './org.apache.solr.cloud.DeleteReplicaTest-controljetty-1383998148803/delLiveColl_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 32173 T267 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 32188 T208 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.DeleteReplicaTest-controljetty-1383998148803/delLiveColl_shard1_replica2/data/index
[junit4] 2> 32189 T208 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=23, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5966174100960888]
[junit4] 2> 32191 T225 oascc.SolrZkClient.makePath makePath: /collections/delLiveColl/leader_elect/shard2/election
[junit4] 2> 32200 T267 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 32202 T208 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@e6bbf9 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@c40f9),segFN=segments_1,generation=1}
[junit4] 2> 32203 T208 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 32252 T267 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 32253 T267 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 32253 T267 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 32266 T267 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 32266 T267 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 32267 T267 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 32267 T267 oasc.SolrCore.<init> [delLiveColl_shard2_replica2] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty4-1383998153352/delLiveColl_shard2_replica2/, dataDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty4-1383998153352/delLiveColl_shard2_replica2/data/
[junit4] 2> 32268 T267 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12e8306
[junit4] 2> 32270 T267 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty4-1383998153352/delLiveColl_shard2_replica2/data
[junit4] 2> 32270 T267 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty4-1383998153352/delLiveColl_shard2_replica2/data/index/
[junit4] 2> 32271 T267 oasc.SolrCore.initIndex WARN [delLiveColl_shard2_replica2] Solr index directory '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty4-1383998153352/delLiveColl_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 32266 T239 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 32266 T225 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 32256 T208 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 32276 T208 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 32276 T225 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=179999
[junit4] 2> 32277 T208 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 32277 T208 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 32278 T208 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 32279 T208 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 32280 T239 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 32280 T208 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 32288 T267 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty4-1383998153352/delLiveColl_shard2_replica2/data/index
[junit4] 2> 32291 T267 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=23, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5966174100960888]
[junit4] 2> 32293 T267 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@663554 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@158e1a),segFN=segments_1,generation=1}
[junit4] 2> 32294 T267 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 32294 T239 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 32296 T239 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 32297 T239 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 32298 T239 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 32305 T267 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 32306 T267 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 32307 T267 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 32307 T267 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 32308 T267 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 32309 T239 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 32308 T208 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 32310 T239 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 32309 T267 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 32311 T239 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 32312 T267 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 32313 T267 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 32313 T267 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 32310 T208 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 32312 T239 oasc.SolrCore.<init> [delLiveColl_shard1_replica1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty2-1383998150527/delLiveColl_shard1_replica1/, dataDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty2-1383998150527/delLiveColl_shard1_replica1/data/
[junit4] 2> 32316 T239 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12e8306
[junit4] 2> 32315 T267 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 32317 T239 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty2-1383998150527/delLiveColl_shard1_replica1/data
[junit4] 2> 32316 T208 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 32318 T239 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty2-1383998150527/delLiveColl_shard1_replica1/data/index/
[junit4] 2> 32319 T239 oasc.SolrCore.initIndex WARN [delLiveColl_shard1_replica1] Solr index directory '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty2-1383998150527/delLiveColl_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 32320 T239 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteReplicaTest-jetty2-1383998150527/delLiveColl_shard1_replica1/data/index
[junit4] 2> 32320 T239 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=23, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5966174100960888]
[junit4] 2> 32318 T267 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 32322 T239 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1711a77 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3c56ff),segFN=segments_1,generation=1}
[junit4] 2> 32323 T239 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 32319 T208 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 32326 T208 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 32322 T267 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 32327 T208 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 32328 T267 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 32329 T208 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 32329 T267 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 32330 T267 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 32330 T208 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 32333 T267 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 32338 T208 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 32351 T208 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 32352 T267 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 32353 T239 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 32352 T208 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 32353 T239 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 32354 T239 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 32355 T239 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 32355 T239 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 32356 T239 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 32356 T239 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 32353 T267 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 32358 T267 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=17, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=65.19921875, floorSegmentMB=0.9140625, forceMergeDeletesPctAllowed=26.454089368367512, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 32359 T267 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@663554 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@158e1a),segFN=segments_1,generation=1}
[junit4] 2> 32359 T267 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 32360 T267 oass.SolrIndexSearcher.<init> Opening Searcher@a01d4c main
[junit4] 2> 32357 T239 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 32365 T239 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 32366 T239 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 32355 T208 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=17, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=65.19921875, floorSegmentMB=0.9140625, forceMergeDeletesPctAllowed=26.454089368367512, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 32367 T239 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 32368 T239 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 32366 T284 oasc.SolrCore.registerSearcher [delLiveCo
[...truncated too long message...]
endThread.run WARN Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4] 2>
[junit4] 2> 123992 T278 oaz.ClientCnxn$EventThread.run ERROR Event thread exiting due to interruption java.lang.InterruptedException
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2052)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
[junit4] 2>
[junit4] 2> 124492 T277 oazc.StaticHostProvider.next WARN Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4] 2>
[junit4] 2> 124493 T277 oaz.ClientCnxn$SendThread.run WARN Session 0x1423cb7cff5000e for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:735)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 124992 T277 oaz.ClientCnxn$SendThread.run WARN Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4] 2>
[junit4] 2> 125492 T277 oazc.StaticHostProvider.next WARN Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4] 2>
[junit4] 2> 125493 T277 oaz.ClientCnxn$SendThread.run WARN Session 0x1423cb7cff5000e for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:735)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 125993 T277 oaz.ClientCnxn$SendThread.run WARN Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4] 2>
[junit4] 2> 126493 T277 oazc.StaticHostProvider.next WARN Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4] 2>
[junit4] 2> 126494 T277 oaz.ClientCnxn$SendThread.run WARN Session 0x1423cb7cff5000e for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:735)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 106459 T189 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=277, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[77FAE56CCE485EF0]-SendThread(localhost.localdomain:46343), state=TIMED_WAITING, group=TGRP-DeleteReplicaTest]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4] 2> NOTE: test params are: codec=Lucene46: {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=lv, timezone=America/Argentina/Salta
[junit4] 2> NOTE: Linux 3.8.0-32-generic i386/Oracle Corporation 1.7.0_45 (32-bit)/cpus=8,threads=3,free=172177784,total=213909504
[junit4] 2> NOTE: All tests run in this JVM: [LeaderElectionTest, PolyFieldTest, DeleteReplicaTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=DeleteReplicaTest -Dtests.seed=77FAE56CCE485EF0 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=lv -Dtests.timezone=America/Argentina/Salta -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s J0 | DeleteReplicaTest (suite) <<<
[junit4] > Throwable #1: java.lang.AssertionError: ERROR: SolrZkClient opens=15 closes=14
[junit4] > at __randomizedtesting.SeedInfo.seed([77FAE56CCE485EF0]:0)
[junit4] > at org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:343)
[junit4] > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:135)
[junit4] > at java.lang.Thread.run(Thread.java:744)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.DeleteReplicaTest:
[junit4] > 1) Thread[id=278, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[77FAE56CCE485EF0]-EventThread, state=WAITING, group=TGRP-DeleteReplicaTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
[junit4] > 2) Thread[id=277, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[77FAE56CCE485EF0]-SendThread(localhost.localdomain:46343), state=TIMED_WAITING, group=TGRP-DeleteReplicaTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4] > at __randomizedtesting.SeedInfo.seed([77FAE56CCE485EF0]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=277, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[77FAE56CCE485EF0]-SendThread(localhost.localdomain:46343), state=TIMED_WAITING, group=TGRP-DeleteReplicaTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4] > at __randomizedtesting.SeedInfo.seed([77FAE56CCE485EF0]:0)
[junit4] Completed on J0 in 106.56s, 1 test, 1 failure, 3 errors <<< FAILURES!
[...truncated 992 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:428: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:408: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:483: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1275: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:911: There were test failures: 335 suites, 1475 tests, 3 suite-level errors, 1 error, 1050 ignored (5 assumptions)
Total time: 37 minutes 44 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_45 -server -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure