You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/11/29 18:52:55 UTC
[JENKINS] Lucene-Solr-4.x-MacOSX (64bit/jdk1.6.0) - Build # 1047 -
Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-MacOSX/1047/
Java: 64bit/jdk1.6.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.testDistribSearch
Error Message:
There were expected update fails expected:<0> but was:<1>
Stack Trace:
java.lang.AssertionError: There were expected update fails expected:<0> but was:<1>
at __randomizedtesting.SeedInfo.seed([A450BDCAE447023A:25B633D293186206]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.doTest(ChaosMonkeyNothingIsSafeTest.java:191)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:843)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:695)
Build Log:
[...truncated 10215 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
[junit4] 2> 2936683 T8294 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /k/ha
[junit4] 2> 2936690 T8294 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeyNothingIsSafeTest-1385746955583
[junit4] 2> 2936695 T8294 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 2936697 T8295 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2936798 T8294 oasc.ZkTestServer.run start zk server on port:51823
[junit4] 2> 2936800 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2936812 T8301 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6735733e name:ZooKeeperConnection Watcher:127.0.0.1:51823 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2936812 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2936813 T8294 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2936833 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2936839 T8303 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@707f38ba name:ZooKeeperConnection Watcher:127.0.0.1:51823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2936839 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2936840 T8294 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 2936850 T8294 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 2936858 T8294 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 2936865 T8294 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 2936876 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2936877 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 2936892 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 2936893 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 2936903 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2936904 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2936914 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2936915 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 2936924 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2936925 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 2936935 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2936935 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 2936949 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 2936950 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 2936962 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2936964 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 2936975 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2936976 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2936987 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2936989 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 2937000 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2937001 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 2937547 T8294 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2937556 T8294 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51826
[junit4] 2> 2937557 T8294 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2937557 T8294 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2937558 T8294 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385746955904
[junit4] 2> 2937558 T8294 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385746955904/'
[junit4] 2> 2937594 T8294 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385746955904/solr.xml
[junit4] 2> 2937652 T8294 oasc.CoreContainer.<init> New CoreContainer 108431743
[junit4] 2> 2937653 T8294 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385746955904/]
[junit4] 2> 2937654 T8294 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2937654 T8294 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2937655 T8294 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2937655 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2937656 T8294 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2937656 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2937657 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2937657 T8294 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2937658 T8294 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2937685 T8294 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2937686 T8294 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2937686 T8294 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2937687 T8294 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51823/solr
[junit4] 2> 2937687 T8294 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2937689 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2937695 T8314 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@503cf429 name:ZooKeeperConnection Watcher:127.0.0.1:51823 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2937696 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2937702 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2937706 T8316 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2635390a name:ZooKeeperConnection Watcher:127.0.0.1:51823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2937706 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2937711 T8294 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2937723 T8294 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2937735 T8294 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2937742 T8294 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51826_k%2Fha
[junit4] 2> 2937744 T8294 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51826_k%2Fha
[junit4] 2> 2937755 T8294 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2937772 T8294 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2937782 T8294 oasc.Overseer.start Overseer (id=90816312482136067-127.0.0.1:51826_k%2Fha-n_0000000000) starting
[junit4] 2> 2937794 T8294 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2937810 T8318 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2937812 T8294 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2937821 T8294 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2937828 T8294 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2937839 T8317 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2937844 T8319 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 2937844 T8319 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2937847 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2937847 T8319 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2937852 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2937855 T8317 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:51826/k/ha",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51826_k%2Fha",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2937855 T8317 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 2937855 T8317 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2937864 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2937867 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2938849 T8319 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2938849 T8319 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385746955904/collection1
[junit4] 2> 2938850 T8319 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 2938852 T8319 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2938853 T8319 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 2938858 T8319 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385746955904/collection1/'
[junit4] 2> 2938860 T8319 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385746955904/collection1/lib/classes/' to classloader
[junit4] 2> 2938861 T8319 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385746955904/collection1/lib/README' to classloader
[junit4] 2> 2938924 T8319 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 2938987 T8319 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2938993 T8319 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2939006 T8319 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2939602 T8319 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2939604 T8319 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2939605 T8319 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2939624 T8319 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2939628 T8319 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2939676 T8319 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2939684 T8319 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2939692 T8319 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2939697 T8319 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2939698 T8319 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2939698 T8319 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2939702 T8319 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2939703 T8319 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2939703 T8319 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 2939704 T8319 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385746955904/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/control/data/
[junit4] 2> 2939704 T8319 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@52ba638e
[junit4] 2> 2939706 T8319 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/control/data
[junit4] 2> 2939706 T8319 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/control/data/index/
[junit4] 2> 2939707 T8319 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 2939708 T8319 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/control/data/index
[junit4] 2> 2939709 T8319 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=44, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 2939713 T8319 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 2939713 T8319 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2939716 T8319 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2939718 T8319 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2939718 T8319 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2939719 T8319 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2939719 T8319 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2939719 T8319 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2939720 T8319 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2939720 T8319 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2939721 T8319 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2939723 T8319 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2939723 T8319 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2939724 T8319 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2939724 T8319 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2939725 T8319 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2939725 T8319 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2939726 T8319 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2939731 T8319 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2939736 T8319 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2939736 T8319 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2939737 T8319 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=71.9130859375, floorSegmentMB=1.580078125, forceMergeDeletesPctAllowed=18.740117723346046, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 2939739 T8319 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 2939739 T8319 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2939739 T8319 oass.SolrIndexSearcher.<init> Opening Searcher@76bab9e5 main
[junit4] 2> 2939747 T8320 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@76bab9e5 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 2939749 T8319 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2939749 T8319 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51826/k/ha collection:control_collection shard:shard1
[junit4] 2> 2939751 T8319 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 2939780 T8319 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 2939787 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2939790 T8319 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2939790 T8319 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C9504 name=collection1 org.apache.solr.core.SolrCore@34c5d0bd url=http://127.0.0.1:51826/k/ha/collection1 node=127.0.0.1:51826_k%2Fha C9504_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:51826/k/ha, core=collection1, node_name=127.0.0.1:51826_k%2Fha}
[junit4] 2> 2939791 T8319 C9504 P51826 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51826/k/ha/collection1/
[junit4] 2> 2939793 T8319 C9504 P51826 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2939793 T8319 C9504 P51826 oasc.SyncStrategy.syncToMe http://127.0.0.1:51826/k/ha/collection1/ has no replicas
[junit4] 2> 2939794 T8319 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51826/k/ha/collection1/ shard1
[junit4] 2> 2939795 T8319 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 2939795 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2939812 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2939815 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2939838 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2939851 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2939961 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2939986 T8319 oasc.ZkController.register We are http://127.0.0.1:51826/k/ha/collection1/ and leader is http://127.0.0.1:51826/k/ha/collection1/
[junit4] 2> 2939986 T8319 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51826/k/ha
[junit4] 2> 2939987 T8319 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2939987 T8319 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 2939987 T8319 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2939990 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2939991 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2939991 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2939992 T8319 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2939996 T8294 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2939997 T8294 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2939997 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2940000 T8317 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:51826/k/ha",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51826_k%2Fha",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 2940002 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2940006 T8323 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a2d92c5 name:ZooKeeperConnection Watcher:127.0.0.1:51823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2940006 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2940013 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2940014 T8294 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2940027 T8294 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 2940121 T8323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2940122 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2940371 T8294 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2940379 T8294 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51830
[junit4] 2> 2940380 T8294 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2940381 T8294 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2940381 T8294 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385746958917
[junit4] 2> 2940382 T8294 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385746958917/'
[junit4] 2> 2940427 T8294 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385746958917/solr.xml
[junit4] 2> 2940471 T8294 oasc.CoreContainer.<init> New CoreContainer 276190271
[junit4] 2> 2940473 T8294 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385746958917/]
[junit4] 2> 2940475 T8294 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2940475 T8294 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2940476 T8294 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2940477 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2940478 T8294 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2940479 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2940480 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2940480 T8294 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2940481 T8294 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2940523 T8294 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2940525 T8294 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2940525 T8294 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2940526 T8294 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51823/solr
[junit4] 2> 2940527 T8294 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2940530 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2940536 T8334 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4894fc8a name:ZooKeeperConnection Watcher:127.0.0.1:51823 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2940537 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2940546 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2940551 T8336 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@356b64cf name:ZooKeeperConnection Watcher:127.0.0.1:51823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2940552 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2940570 T8294 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2941588 T8294 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51830_k%2Fha
[junit4] 2> 2941613 T8294 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51830_k%2Fha
[junit4] 2> 2941626 T8316 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2941629 T8336 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2941631 T8323 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2941656 T8337 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 2941657 T8337 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2941661 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2941662 T8337 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2941662 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2941663 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2941669 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2941672 T8317 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:51830/k/ha",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51830_k%2Fha",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2941673 T8317 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 2941674 T8317 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2941684 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2941688 T8336 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2941689 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2941690 T8323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2942663 T8337 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2942664 T8337 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385746958917/collection1
[junit4] 2> 2942665 T8337 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 2942668 T8337 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2942670 T8337 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2942675 T8337 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385746958917/collection1/'
[junit4] 2> 2942676 T8337 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385746958917/collection1/lib/classes/' to classloader
[junit4] 2> 2942677 T8337 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385746958917/collection1/lib/README' to classloader
[junit4] 2> 2942729 T8337 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 2942775 T8337 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2942779 T8337 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2942793 T8337 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2943301 T8337 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2943303 T8337 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2943304 T8337 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2943311 T8337 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2943315 T8337 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2943353 T8337 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2943360 T8337 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2943367 T8337 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2943371 T8337 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2943372 T8337 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2943372 T8337 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2943377 T8337 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2943377 T8337 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2943378 T8337 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 2943378 T8337 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385746958917/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty1/
[junit4] 2> 2943378 T8337 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@52ba638e
[junit4] 2> 2943384 T8337 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty1
[junit4] 2> 2943384 T8337 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty1/index/
[junit4] 2> 2943385 T8337 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 2943385 T8337 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty1/index
[junit4] 2> 2943386 T8337 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=44, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 2943388 T8337 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 2943389 T8337 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2943396 T8337 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2943397 T8337 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2943398 T8337 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2943398 T8337 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2943399 T8337 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2943399 T8337 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2943401 T8337 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2943401 T8337 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2943402 T8337 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2943403 T8337 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2943404 T8337 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2943404 T8337 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2943405 T8337 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2943405 T8337 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2943406 T8337 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2943406 T8337 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2943412 T8337 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2943416 T8337 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2943416 T8337 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2943417 T8337 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=71.9130859375, floorSegmentMB=1.580078125, forceMergeDeletesPctAllowed=18.740117723346046, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 2943418 T8337 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 2943419 T8337 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2943419 T8337 oass.SolrIndexSearcher.<init> Opening Searcher@2c88c837 main
[junit4] 2> 2943426 T8338 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2c88c837 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 2943428 T8337 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2943428 T8337 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51830/k/ha collection:collection1 shard:shard1
[junit4] 2> 2943431 T8337 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2943456 T8337 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 2943462 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2943465 T8337 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2943465 T8337 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C9505 name=collection1 org.apache.solr.core.SolrCore@3ceb695b url=http://127.0.0.1:51830/k/ha/collection1 node=127.0.0.1:51830_k%2Fha C9505_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:51830/k/ha, core=collection1, node_name=127.0.0.1:51830_k%2Fha}
[junit4] 2> 2943466 T8337 C9505 P51830 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51830/k/ha/collection1/
[junit4] 2> 2943467 T8337 C9505 P51830 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2943467 T8337 C9505 P51830 oasc.SyncStrategy.syncToMe http://127.0.0.1:51830/k/ha/collection1/ has no replicas
[junit4] 2> 2943468 T8337 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51830/k/ha/collection1/ shard1
[junit4] 2> 2943469 T8337 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2943469 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2943485 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2943488 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2943489 T8323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2943490 T8336 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2943510 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2943520 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2943627 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2943628 T8323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2943628 T8336 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2943660 T8337 oasc.ZkController.register We are http://127.0.0.1:51830/k/ha/collection1/ and leader is http://127.0.0.1:51830/k/ha/collection1/
[junit4] 2> 2943661 T8337 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51830/k/ha
[junit4] 2> 2943661 T8337 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2943661 T8337 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 2943662 T8337 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2943664 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2943665 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2943665 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2943672 T8337 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2943675 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2943676 T8294 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2943677 T8294 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2943677 T8317 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:51830/k/ha",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51830_k%2Fha",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 2943690 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2943799 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2943800 T8336 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2943800 T8323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2943998 T8294 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2944005 T8294 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51833
[junit4] 2> 2944006 T8294 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2944007 T8294 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2944007 T8294 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385746962569
[junit4] 2> 2944008 T8294 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385746962569/'
[junit4] 2> 2944034 T8294 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385746962569/solr.xml
[junit4] 2> 2944085 T8294 oasc.CoreContainer.<init> New CoreContainer 858321732
[junit4] 2> 2944086 T8294 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385746962569/]
[junit4] 2> 2944087 T8294 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2944088 T8294 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2944088 T8294 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2944089 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2944090 T8294 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2944090 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2944091 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2944091 T8294 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2944092 T8294 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2944117 T8294 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2944118 T8294 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2944118 T8294 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2944119 T8294 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51823/solr
[junit4] 2> 2944119 T8294 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2944121 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2944126 T8350 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@457b0f99 name:ZooKeeperConnection Watcher:127.0.0.1:51823 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2944126 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2944132 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2944137 T8352 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4caddcdf name:ZooKeeperConnection Watcher:127.0.0.1:51823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2944137 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2944150 T8294 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2945162 T8294 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51833_k%2Fha
[junit4] 2> 2945166 T8294 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51833_k%2Fha
[junit4] 2> 2945179 T8323 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2945180 T8352 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2945182 T8316 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2945183 T8336 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2945196 T8353 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 2945197 T8353 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2945200 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2945200 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2945200 T8353 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2945200 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2945207 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2945210 T8317 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:51833/k/ha",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51833_k%2Fha",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2945210 T8317 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 2945211 T8317 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 2945220 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2945330 T8336 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2945331 T8323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2945332 T8352 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2945331 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2946206 T8353 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2946206 T8353 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385746962569/collection1
[junit4] 2> 2946207 T8353 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 2946209 T8353 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2946209 T8353 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2946213 T8353 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385746962569/collection1/'
[junit4] 2> 2946214 T8353 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385746962569/collection1/lib/classes/' to classloader
[junit4] 2> 2946215 T8353 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385746962569/collection1/lib/README' to classloader
[junit4] 2> 2946261 T8353 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 2946307 T8353 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2946311 T8353 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2946319 T8353 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2946805 T8353 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2946806 T8353 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2946807 T8353 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2946815 T8353 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2946820 T8353 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2946865 T8353 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2946872 T8353 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2946879 T8353 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2946884 T8353 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2946884 T8353 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2946885 T8353 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2946889 T8353 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2946889 T8353 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2946890 T8353 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 2946890 T8353 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385746962569/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty2/
[junit4] 2> 2946891 T8353 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@52ba638e
[junit4] 2> 2946892 T8353 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty2
[junit4] 2> 2946892 T8353 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty2/index/
[junit4] 2> 2946893 T8353 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 2946894 T8353 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty2/index
[junit4] 2> 2946894 T8353 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=44, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 2946898 T8353 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 2946898 T8353 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2946902 T8353 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2946903 T8353 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2946903 T8353 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2946904 T8353 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2946904 T8353 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2946905 T8353 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2946905 T8353 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2946906 T8353 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2946906 T8353 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2946907 T8353 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2946908 T8353 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2946908 T8353 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2946909 T8353 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2946909 T8353 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2946910 T8353 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2946910 T8353 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2946918 T8353 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2946922 T8353 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2946922 T8353 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2946923 T8353 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=71.9130859375, floorSegmentMB=1.580078125, forceMergeDeletesPctAllowed=18.740117723346046, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 2946925 T8353 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 2946925 T8353 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2946925 T8353 oass.SolrIndexSearcher.<init> Opening Searcher@5ca190f4 main
[junit4] 2> 2946932 T8354 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5ca190f4 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 2946935 T8353 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2946935 T8353 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51833/k/ha collection:collection1 shard:shard2
[junit4] 2> 2946938 T8353 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 2946960 T8353 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 2946967 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2946972 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2946972 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2946974 T8353 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2946975 T8353 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C9506 name=collection1 org.apache.solr.core.SolrCore@28081eb9 url=http://127.0.0.1:51833/k/ha/collection1 node=127.0.0.1:51833_k%2Fha C9506_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:51833/k/ha, core=collection1, node_name=127.0.0.1:51833_k%2Fha}
[junit4] 2> 2946975 T8353 C9506 P51833 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51833/k/ha/collection1/
[junit4] 2> 2946976 T8353 C9506 P51833 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2946976 T8353 C9506 P51833 oasc.SyncStrategy.syncToMe http://127.0.0.1:51833/k/ha/collection1/ has no replicas
[junit4] 2> 2946976 T8353 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51833/k/ha/collection1/ shard2
[junit4] 2> 2946977 T8353 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 2946977 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2946997 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2947000 T8323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2947000 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2947001 T8352 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2947000 T8336 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2947025 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2947035 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2947142 T8323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2947143 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2947144 T8352 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2947144 T8336 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2947179 T8353 oasc.ZkController.register We are http://127.0.0.1:51833/k/ha/collection1/ and leader is http://127.0.0.1:51833/k/ha/collection1/
[junit4] 2> 2947179 T8353 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51833/k/ha
[junit4] 2> 2947180 T8353 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2947180 T8353 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 2947180 T8353 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2947182 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2947182 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2947183 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2947184 T8353 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2947192 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2947192 T8294 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2947193 T8294 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2947194 T8317 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:51833/k/ha",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51833_k%2Fha",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 2947203 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2947313 T8323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2947318 T8352 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2947322 T8336 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2947323 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2947509 T8294 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2947514 T8294 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51836
[junit4] 2> 2947515 T8294 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2947517 T8294 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2947518 T8294 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385746966084
[junit4] 2> 2947519 T8294 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385746966084/'
[junit4] 2> 2947552 T8294 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385746966084/solr.xml
[junit4] 2> 2947610 T8294 oasc.CoreContainer.<init> New CoreContainer 725054923
[junit4] 2> 2947611 T8294 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385746966084/]
[junit4] 2> 2947613 T8294 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2947613 T8294 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2947614 T8294 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2947614 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2947614 T8294 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2947615 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2947616 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2947617 T8294 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2947618 T8294 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2947649 T8294 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2947650 T8294 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2947651 T8294 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2947651 T8294 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51823/solr
[junit4] 2> 2947652 T8294 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2947653 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2947659 T8366 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@46167897 name:ZooKeeperConnection Watcher:127.0.0.1:51823 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2947659 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2947666 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2947671 T8368 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d307784 name:ZooKeeperConnection Watcher:127.0.0.1:51823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2947672 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2947686 T8294 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2948698 T8294 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51836_k%2Fha
[junit4] 2> 2948701 T8294 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51836_k%2Fha
[junit4] 2> 2948714 T8316 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2948717 T8368 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2948717 T8336 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2948721 T8352 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2948722 T8323 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2948740 T8369 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 2948741 T8369 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2948744 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2948744 T8369 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2948744 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2948745 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2948750 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2948752 T8317 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:51836/k/ha",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51836_k%2Fha",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2948752 T8317 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 2948753 T8317 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2948761 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2948870 T8352 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 2948870 T8368 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 2948871 T8336 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 2948871 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 2948873 T8323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes siz
[...truncated too long message...]
[junit4] FAILURE 99.4s | ChaosMonkeyNothingIsSafeTest.testDistribSearch <<<
[junit4] > Throwable #1: java.lang.AssertionError: There were expected update fails expected:<0> but was:<1>
[junit4] > at __randomizedtesting.SeedInfo.seed([A450BDCAE447023A:25B633D293186206]:0)
[junit4] > at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.doTest(ChaosMonkeyNothingIsSafeTest.java:191)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:843)
[junit4] > at java.lang.Thread.run(Thread.java:695)
[junit4] 2> 3036108 T8294 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 99435 T8293 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> 3036282 T8421 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 3037378 T8439 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Lucene46: {timestamp=PostingsFormat(name=TestBloomFilteredLucene41Postings), range_facet_l=PostingsFormat(name=TestBloomFilteredLucene41Postings), id=PostingsFormat(name=MockSep), range_facet_sl=PostingsFormat(name=MockSep), a_t=PostingsFormat(name=TestBloomFilteredLucene41Postings), text=PostingsFormat(name=Direct), range_facet_si=PostingsFormat(name=TestBloomFilteredLucene41Postings), _version_=PostingsFormat(name=MockRandom), other_tl1=PostingsFormat(name=MockRandom), multiDefault=PostingsFormat(name=TestBloomFilteredLucene41Postings), a_si=PostingsFormat(name=MockRandom), intDefault=PostingsFormat(name=MockRandom)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=ar_QA, timezone=Asia/Dhaka
[junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Apple Inc. 1.6.0_65 (64-bit)/cpus=2,threads=3,free=271035496,total=532545536
[junit4] 2> NOTE: All tests run in this JVM: [TestUtils, PluginInfoTest, CircularListTest, FileBasedSpellCheckerTest, PrimUtilsTest, TestSolrXmlPersistor, TestBM25SimilarityFactory, TestSolrQueryParser, TestIndexSearcher, TestCustomSort, CachingDirectoryFactoryTest, BinaryUpdateRequestHandlerTest, SystemInfoHandlerTest, JSONWriterTest, CopyFieldTest, TestValueSourceCache, DisMaxRequestHandlerTest, TestQueryTypes, TestDFRSimilarityFactory, ModifyConfFileTest, BJQParserTest, TestSimpleQParserPlugin, InfoHandlerTest, TestCharFilters, SuggesterFSTTest, RequiredFieldsTest, LoggingHandlerTest, TestBadConfig, SuggesterWFSTTest, TestSolrXmlPersistence, MBeansHandlerTest, StressHdfsTest, DirectUpdateHandlerOptimizeTest, ExternalFileFieldSortTest, TestRangeQuery, TestSystemIdResolver, NotRequiredUniqueKeyTest, SOLR749Test, TestHighFrequencyDictionaryFactory, TestPartialUpdateDeduplication, TestFieldTypeResource, TestFiltering, TestSolrQueryParserResource, EchoParamsTest, AnalysisAfterCoreReloadTest, TestDefaultSearchFieldResource, TestStressUserVersions, TestAtomicUpdateErrorCases, SuggesterTSTTest, SignatureUpdateProcessorFactoryTest, TestGroupingSearch, TestPHPSerializedResponseWriter, TestMergePolicyConfig, BadComponentTest, HdfsRecoveryZkTest, UniqFieldsUpdateProcessorFactoryTest, FastVectorHighlighterTest, TestSolrDeletionPolicy1, CoreContainerCoreInitFailuresTest, CollectionsAPIDistributedZkTest, TriLevelCompositeIdRoutingTest, TestSolrDeletionPolicy2, TestRecovery, SortByFunctionTest, TestSchemaResource, CacheHeaderTest, ClusterStateUpdateTest, DebugComponentTest, StatelessScriptUpdateProcessorFactoryTest, TestSolrXMLSerializer, OverseerCollectionProcessorTest, TestDocBasedVersionConstraints, FullSolrCloudDistribCmdsTest, TermVectorComponentTest, ReturnFieldsTest, TestDistribDocBasedVersion, TestModifyConfFiles, TestSurroundQueryParser, TestShardHandlerFactory, TestDistributedSearch, AddBlockUpdateTest, AddSchemaFieldsUpdateProcessorFactoryTest, SpellingQueryConverterTest, TestFuzzyAnalyzedSuggestions, SchemaVersionSpecificBehaviorTest, SolrIndexSplitterTest, DistributedDebugComponentTest, TestComponentsName, TestClassNameShortening, SpellCheckCollatorTest, CoreAdminHandlerTest, TestFaceting, BlockDirectoryTest, TestOmitPositions, DOMUtilTest, SuggestComponentTest, OutputWriterTest, TestQuerySenderListener, HdfsBasicDistributedZk2Test, HdfsCollectionsAPIDistributedZkTest, DeleteShardTest, TestSerializedLuceneMatchVersion, OpenCloseCoreStressTest, TestCoreContainer, HardAutoCommitTest, BlockCacheTest, TestQuerySenderNoQuery, TestPhraseSuggestions, PreAnalyzedFieldTest, HdfsBasicDistributedZkTest, TestIndexingPerformance, TestBinaryField, TestMultiCoreConfBootstrap, ShardRoutingCustomTest, HighlighterTest, TestHashPartitioner, HdfsDirectoryTest, TestDistributedMissingSort, HdfsChaosMonkeySafeLeaderTest, TestRealTimeGet, AssignTest, RecoveryZkTest, TestPseudoReturnFields, DistributedQueryElevationComponentTest, TestImplicitCoreProperties, StandardRequestHandlerTest, TestConfig, TestFieldResource, UnloadDistributedZkTest, TestLazyCores, SyncSliceTest, TestXIncludeConfig, TestReversedWildcardFilterFactory, TestWordDelimiterFilterFactory, CSVRequestHandlerTest, UUIDFieldTest, TestCSVLoader, TestFileDictionaryLookup, SliceStateUpdateTest, LegacyHTMLStripCharFilterTest, FileUtilsTest, ResponseLogComponentTest, ShowFileRequestHandlerTest, TestSchemaSimilarityResource, TestSweetSpotSimilarityFactory, TestSolrIndexConfig, DateFieldTest, TestAnalyzeInfixSuggestions, ResourceLoaderTest, PreAnalyzedUpdateProcessorTest, DocumentAnalysisRequestHandlerTest, TestSolrJ, XmlUpdateRequestHandlerTest, SolrTestCaseJ4Test, PeerSyncTest, TestNRTOpen, TestJmxMonitoredMap, TestFieldCollectionResource, DistributedSuggesterComponentTest, TestRandomMergePolicy, TermsComponentTest, TestStressReorder, ShardRoutingTest, TestDocumentBuilder, DocValuesMultiTest, DeleteInactiveReplicaTest, TestFastOutputStream, QueryParsingTest, TestPostingsSolrHighlighter, TestInfoStreamLogging, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, OverseerTest, LeaderElectionIntegrationTest, BasicZkTest, TestReplicationHandler, TestRandomFaceting, LeaderElectionTest, ZkSolrClientTest, TestZkChroot, TestRandomDVFaceting, ZkCLITest, AutoCommitTest, TestDistributedGrouping, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, ZkControllerTest, TestJoin, TestReload, TestStressVersions, DistributedTermsComponentTest, SimpleFacetsTest, TestSolr4Spatial, SolrCoreTest, StatsComponentTest, SpellCheckComponentTest, SolrCmdDistributorTest, QueryElevationComponentTest, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestFunctionQuery, BasicFunctionalityTest, DirectUpdateHandlerTest, SoftAutoCommitTest, CurrencyFieldOpenExchangeTest, CurrencyFieldXmlFileTest, SimplePostToolTest, TestCoreDiscovery, TestExtendedDismaxParser, SolrRequestParserTest, TestFoldingMultitermQuery, DocValuesTest, SuggesterTest, TestStressLucene, TestTrie, SpatialFilterTest, PolyFieldTest, NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, SolrCoreCheckLockOnStartupTest, TestUpdate, FieldMutatingUpdateProcessorTest, QueryEqualityTest, DefaultValueUpdateProcessorTest, TestRemoteStreaming, DistanceFunctionTest, SolrInfoMBeanTest, XsltUpdateRequestHandlerTest, IndexBasedSpellCheckerTest, LukeRequestHandlerTest, TestQueryUtils, TestWriterPerf, DirectSolrSpellCheckerTest, PrimitiveFieldTypeTest, RequestHandlersTest, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, TestArbitraryIndexDir, IndexSchemaRuntimeFieldTest, RegexBoostProcessorTest, SolrPluginUtilsTest, IndexSchemaTest, TestJmxIntegration, TestCollationField, UpdateRequestProcessorFactoryTest, TestCSVResponseWriter, TestAnalyzedSuggestions, JsonLoaderTest, PingRequestHandlerTest, SearchHandlerTest, TestBinaryResponseWriter, TestLFUCache, HighlighterConfigTest, UpdateParamsTest, AlternateDirectoryTest, SolrIndexConfigTest, TestStressRecovery, MultiTermTest, SampleTest, TestDocSet, TestSearchPerf, NumericFieldsTest, MinimalSchemaTest, TestElisionMultitermQuery, TestSolrCoreProperties, DirectSolrConnectionTest, TestLuceneMatchVersion, SpellPossibilityIteratorTest, TestCodecSupport, SynonymTokenizerTest, TestPerFieldSimilarity, TestNumberUtils, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestIBSimilarityFactory, TestDefaultSimilarityFactory, TestFastWriter, TimeZoneUtilsTest, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, TestFastLRUCache, DateMathParserTest, ChaosMonkeyNothingIsSafeTest]
[junit4] Completed in 100.76s, 1 test, 1 failure <<< FAILURES!
[...truncated 177 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:426: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:406: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/extra-targets.xml:37: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build.xml:189: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/common-build.xml:491: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:1279: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:912: There were test failures: 349 suites, 1516 tests, 1 failure, 39 ignored (5 assumptions)
Total time: 94 minutes 25 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.6.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
Re: [JENKINS] Lucene-Solr-4.x-MacOSX (64bit/jdk1.6.0) - Build # 1047 - Still Failing!
Posted by Mark Miller <ma...@gmail.com>.
I’ll work this out eventually. Technically, this is not a fail. But at the same time, we want to test that it ‘usually’ doesn’t happen.
- Mark
On Nov 29, 2013, at 12:52 PM, Policeman Jenkins Server <je...@thetaphi.de> wrote:
> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-MacOSX/1047/
> Java: 64bit/jdk1.6.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
>
> 1 tests failed.
> REGRESSION: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.testDistribSearch
>
> Error Message:
> There were expected update fails expected:<0> but was:<1>
>
> Stack Trace:
> java.lang.AssertionError: There were expected update fails expected:<0> but was:<1>
> at __randomizedtesting.SeedInfo.seed([A450BDCAE447023A:25B633D293186206]:0)
> at org.junit.Assert.fail(Assert.java:93)
> at org.junit.Assert.failNotEquals(Assert.java:647)
> at org.junit.Assert.assertEquals(Assert.java:128)
> at org.junit.Assert.assertEquals(Assert.java:472)
> at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.doTest(ChaosMonkeyNothingIsSafeTest.java:191)
> at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:843)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> at java.lang.Thread.run(Thread.java:695)
>
>
>
>
> Build Log:
> [...truncated 10215 lines...]
> [junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
> [junit4] 2> 2936683 T8294 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /k/ha
> [junit4] 2> 2936690 T8294 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
> [junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeyNothingIsSafeTest-1385746955583
> [junit4] 2> 2936695 T8294 oasc.ZkTestServer.run STARTING ZK TEST SERVER
> [junit4] 2> 2936697 T8295 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
> [junit4] 2> 2936798 T8294 oasc.ZkTestServer.run start zk server on port:51823
> [junit4] 2> 2936800 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 2936812 T8301 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6735733e name:ZooKeeperConnection Watcher:127.0.0.1:51823 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 2936812 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 2936813 T8294 oascc.SolrZkClient.makePath makePath: /solr
> [junit4] 2> 2936833 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 2936839 T8303 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@707f38ba name:ZooKeeperConnection Watcher:127.0.0.1:51823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 2936839 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 2936840 T8294 oascc.SolrZkClient.makePath makePath: /collections/collection1
> [junit4] 2> 2936850 T8294 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
> [junit4] 2> 2936858 T8294 oascc.SolrZkClient.makePath makePath: /collections/control_collection
> [junit4] 2> 2936865 T8294 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
> [junit4] 2> 2936876 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
> [junit4] 2> 2936877 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
> [junit4] 2> 2936892 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
> [junit4] 2> 2936893 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
> [junit4] 2> 2936903 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
> [junit4] 2> 2936904 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
> [junit4] 2> 2936914 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
> [junit4] 2> 2936915 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
> [junit4] 2> 2936924 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
> [junit4] 2> 2936925 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
> [junit4] 2> 2936935 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
> [junit4] 2> 2936935 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
> [junit4] 2> 2936949 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
> [junit4] 2> 2936950 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
> [junit4] 2> 2936962 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
> [junit4] 2> 2936964 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
> [junit4] 2> 2936975 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
> [junit4] 2> 2936976 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
> [junit4] 2> 2936987 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
> [junit4] 2> 2936989 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
> [junit4] 2> 2937000 T8294 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
> [junit4] 2> 2937001 T8294 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
> [junit4] 2> 2937547 T8294 oejs.Server.doStart jetty-8.1.10.v20130312
> [junit4] 2> 2937556 T8294 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51826
> [junit4] 2> 2937557 T8294 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4] 2> 2937557 T8294 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4] 2> 2937558 T8294 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385746955904
> [junit4] 2> 2937558 T8294 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385746955904/'
> [junit4] 2> 2937594 T8294 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385746955904/solr.xml
> [junit4] 2> 2937652 T8294 oasc.CoreContainer.<init> New CoreContainer 108431743
> [junit4] 2> 2937653 T8294 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385746955904/]
> [junit4] 2> 2937654 T8294 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
> [junit4] 2> 2937654 T8294 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4] 2> 2937655 T8294 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4] 2> 2937655 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4] 2> 2937656 T8294 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4] 2> 2937656 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4] 2> 2937657 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4] 2> 2937657 T8294 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4] 2> 2937658 T8294 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4] 2> 2937685 T8294 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
> [junit4] 2> 2937686 T8294 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
> [junit4] 2> 2937686 T8294 oasc.CoreContainer.load Host Name: 127.0.0.1
> [junit4] 2> 2937687 T8294 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51823/solr
> [junit4] 2> 2937687 T8294 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4] 2> 2937689 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 2937695 T8314 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@503cf429 name:ZooKeeperConnection Watcher:127.0.0.1:51823 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 2937696 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 2937702 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 2937706 T8316 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2635390a name:ZooKeeperConnection Watcher:127.0.0.1:51823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 2937706 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 2937711 T8294 oascc.SolrZkClient.makePath makePath: /overseer/queue
> [junit4] 2> 2937723 T8294 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
> [junit4] 2> 2937735 T8294 oascc.SolrZkClient.makePath makePath: /live_nodes
> [junit4] 2> 2937742 T8294 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51826_k%2Fha
> [junit4] 2> 2937744 T8294 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51826_k%2Fha
> [junit4] 2> 2937755 T8294 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
> [junit4] 2> 2937772 T8294 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
> [junit4] 2> 2937782 T8294 oasc.Overseer.start Overseer (id=90816312482136067-127.0.0.1:51826_k%2Fha-n_0000000000) starting
> [junit4] 2> 2937794 T8294 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
> [junit4] 2> 2937810 T8318 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
> [junit4] 2> 2937812 T8294 oascc.SolrZkClient.makePath makePath: /clusterstate.json
> [junit4] 2> 2937821 T8294 oascc.SolrZkClient.makePath makePath: /aliases.json
> [junit4] 2> 2937828 T8294 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4] 2> 2937839 T8317 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
> [junit4] 2> 2937844 T8319 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4] 2> 2937844 T8319 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4] 2> 2937847 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2937847 T8319 oasc.ZkController.waitForCoreNodeName look for our core node name
> [junit4] 2> 2937852 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 2937855 T8317 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4] 2> "operation":"state",
> [junit4] 2> "state":"down",
> [junit4] 2> "base_url":"http://127.0.0.1:51826/k/ha",
> [junit4] 2> "core":"collection1",
> [junit4] 2> "roles":null,
> [junit4] 2> "node_name":"127.0.0.1:51826_k%2Fha",
> [junit4] 2> "shard":null,
> [junit4] 2> "shard_range":null,
> [junit4] 2> "shard_state":"active",
> [junit4] 2> "shard_parent":null,
> [junit4] 2> "collection":"control_collection",
> [junit4] 2> "numShards":"1",
> [junit4] 2> "core_node_name":null}
> [junit4] 2> 2937855 T8317 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
> [junit4] 2> 2937855 T8317 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
> [junit4] 2> 2937864 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2937867 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4] 2> 2938849 T8319 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
> [junit4] 2> 2938849 T8319 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385746955904/collection1
> [junit4] 2> 2938850 T8319 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
> [junit4] 2> 2938852 T8319 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4] 2> 2938853 T8319 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
> [junit4] 2> 2938858 T8319 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385746955904/collection1/'
> [junit4] 2> 2938860 T8319 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385746955904/collection1/lib/classes/' to classloader
> [junit4] 2> 2938861 T8319 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385746955904/collection1/lib/README' to classloader
> [junit4] 2> 2938924 T8319 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
> [junit4] 2> 2938987 T8319 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4] 2> 2938993 T8319 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
> [junit4] 2> 2939006 T8319 oass.IndexSchema.readSchema [collection1] Schema name=test
> [junit4] 2> 2939602 T8319 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4] 2> 2939604 T8319 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4] 2> 2939605 T8319 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4] 2> 2939624 T8319 oass.IndexSchema.readSchema default search field in schema is text
> [junit4] 2> 2939628 T8319 oass.IndexSchema.readSchema unique key field: id
> [junit4] 2> 2939676 T8319 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4] 2> 2939684 T8319 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4] 2> 2939692 T8319 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4] 2> 2939697 T8319 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4] 2> 2939698 T8319 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4] 2> 2939698 T8319 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4] 2> 2939702 T8319 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4] 2> 2939703 T8319 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4] 2> 2939703 T8319 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
> [junit4] 2> 2939704 T8319 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385746955904/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/control/data/
> [junit4] 2> 2939704 T8319 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@52ba638e
> [junit4] 2> 2939706 T8319 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/control/data
> [junit4] 2> 2939706 T8319 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/control/data/index/
> [junit4] 2> 2939707 T8319 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/control/data/index' doesn't exist. Creating new index...
> [junit4] 2> 2939708 T8319 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/control/data/index
> [junit4] 2> 2939709 T8319 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=44, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
> [junit4] 2> 2939713 T8319 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
> [junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/control/data/index,segFN=segments_1,generation=1}
> [junit4] 2> 2939713 T8319 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4] 2> 2939716 T8319 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
> [junit4] 2> 2939718 T8319 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
> [junit4] 2> 2939718 T8319 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4] 2> 2939719 T8319 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
> [junit4] 2> 2939719 T8319 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4] 2> 2939719 T8319 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
> [junit4] 2> 2939720 T8319 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4] 2> 2939720 T8319 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4] 2> 2939721 T8319 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
> [junit4] 2> 2939723 T8319 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4] 2> 2939723 T8319 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4] 2> 2939724 T8319 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4] 2> 2939724 T8319 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4] 2> 2939725 T8319 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4] 2> 2939725 T8319 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4] 2> 2939726 T8319 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
> [junit4] 2> 2939731 T8319 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4] 2> 2939736 T8319 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4] 2> 2939736 T8319 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4] 2> 2939737 T8319 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=71.9130859375, floorSegmentMB=1.580078125, forceMergeDeletesPctAllowed=18.740117723346046, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
> [junit4] 2> 2939739 T8319 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
> [junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/control/data/index,segFN=segments_1,generation=1}
> [junit4] 2> 2939739 T8319 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4] 2> 2939739 T8319 oass.SolrIndexSearcher.<init> Opening Searcher@76bab9e5 main
> [junit4] 2> 2939747 T8320 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@76bab9e5 main{StandardDirectoryReader(segments_1:1:nrt)}
> [junit4] 2> 2939749 T8319 oasc.CoreContainer.registerCore registering core: collection1
> [junit4] 2> 2939749 T8319 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51826/k/ha collection:control_collection shard:shard1
> [junit4] 2> 2939751 T8319 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
> [junit4] 2> 2939780 T8319 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
> [junit4] 2> 2939787 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2939790 T8319 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4] 2> 2939790 T8319 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4] 2> ASYNC NEW_CORE C9504 name=collection1 org.apache.solr.core.SolrCore@34c5d0bd url=http://127.0.0.1:51826/k/ha/collection1 node=127.0.0.1:51826_k%2Fha C9504_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:51826/k/ha, core=collection1, node_name=127.0.0.1:51826_k%2Fha}
> [junit4] 2> 2939791 T8319 C9504 P51826 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51826/k/ha/collection1/
> [junit4] 2> 2939793 T8319 C9504 P51826 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4] 2> 2939793 T8319 C9504 P51826 oasc.SyncStrategy.syncToMe http://127.0.0.1:51826/k/ha/collection1/ has no replicas
> [junit4] 2> 2939794 T8319 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51826/k/ha/collection1/ shard1
> [junit4] 2> 2939795 T8319 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
> [junit4] 2> 2939795 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 2939812 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2939815 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4] 2> 2939838 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 2939851 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2939961 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4] 2> 2939986 T8319 oasc.ZkController.register We are http://127.0.0.1:51826/k/ha/collection1/ and leader is http://127.0.0.1:51826/k/ha/collection1/
> [junit4] 2> 2939986 T8319 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51826/k/ha
> [junit4] 2> 2939987 T8319 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4] 2> 2939987 T8319 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4] 2> 2939987 T8319 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4] 2> 2939990 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2939991 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2939991 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2939992 T8319 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 2939996 T8294 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
> [junit4] 2> 2939997 T8294 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4] 2> 2939997 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 2940000 T8317 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4] 2> "operation":"state",
> [junit4] 2> "state":"active",
> [junit4] 2> "base_url":"http://127.0.0.1:51826/k/ha",
> [junit4] 2> "core":"collection1",
> [junit4] 2> "roles":null,
> [junit4] 2> "node_name":"127.0.0.1:51826_k%2Fha",
> [junit4] 2> "shard":"shard1",
> [junit4] 2> "shard_range":null,
> [junit4] 2> "shard_state":"active",
> [junit4] 2> "shard_parent":null,
> [junit4] 2> "collection":"control_collection",
> [junit4] 2> "numShards":"1",
> [junit4] 2> "core_node_name":"core_node1"}
> [junit4] 2> 2940002 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 2940006 T8323 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a2d92c5 name:ZooKeeperConnection Watcher:127.0.0.1:51823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 2940006 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 2940013 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2940014 T8294 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4] 2> 2940027 T8294 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
> [junit4] 2> 2940121 T8323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4] 2> 2940122 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4] 2> 2940371 T8294 oejs.Server.doStart jetty-8.1.10.v20130312
> [junit4] 2> 2940379 T8294 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51830
> [junit4] 2> 2940380 T8294 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4] 2> 2940381 T8294 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4] 2> 2940381 T8294 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385746958917
> [junit4] 2> 2940382 T8294 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385746958917/'
> [junit4] 2> 2940427 T8294 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385746958917/solr.xml
> [junit4] 2> 2940471 T8294 oasc.CoreContainer.<init> New CoreContainer 276190271
> [junit4] 2> 2940473 T8294 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385746958917/]
> [junit4] 2> 2940475 T8294 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
> [junit4] 2> 2940475 T8294 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4] 2> 2940476 T8294 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4] 2> 2940477 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4] 2> 2940478 T8294 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4] 2> 2940479 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4] 2> 2940480 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4] 2> 2940480 T8294 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4] 2> 2940481 T8294 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4] 2> 2940523 T8294 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
> [junit4] 2> 2940525 T8294 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
> [junit4] 2> 2940525 T8294 oasc.CoreContainer.load Host Name: 127.0.0.1
> [junit4] 2> 2940526 T8294 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51823/solr
> [junit4] 2> 2940527 T8294 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4] 2> 2940530 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 2940536 T8334 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4894fc8a name:ZooKeeperConnection Watcher:127.0.0.1:51823 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 2940537 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 2940546 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 2940551 T8336 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@356b64cf name:ZooKeeperConnection Watcher:127.0.0.1:51823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 2940552 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 2940570 T8294 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4] 2> 2941588 T8294 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51830_k%2Fha
> [junit4] 2> 2941613 T8294 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51830_k%2Fha
> [junit4] 2> 2941626 T8316 oascc.ZkStateReader$3.process Updating live nodes... (2)
> [junit4] 2> 2941629 T8336 oascc.ZkStateReader$3.process Updating live nodes... (2)
> [junit4] 2> 2941631 T8323 oascc.ZkStateReader$3.process Updating live nodes... (2)
> [junit4] 2> 2941656 T8337 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4] 2> 2941657 T8337 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4] 2> 2941661 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2941662 T8337 oasc.ZkController.waitForCoreNodeName look for our core node name
> [junit4] 2> 2941662 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2941663 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2941669 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 2941672 T8317 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4] 2> "operation":"state",
> [junit4] 2> "state":"down",
> [junit4] 2> "base_url":"http://127.0.0.1:51830/k/ha",
> [junit4] 2> "core":"collection1",
> [junit4] 2> "roles":null,
> [junit4] 2> "node_name":"127.0.0.1:51830_k%2Fha",
> [junit4] 2> "shard":null,
> [junit4] 2> "shard_range":null,
> [junit4] 2> "shard_state":"active",
> [junit4] 2> "shard_parent":null,
> [junit4] 2> "collection":"collection1",
> [junit4] 2> "numShards":"2",
> [junit4] 2> "core_node_name":null}
> [junit4] 2> 2941673 T8317 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
> [junit4] 2> 2941674 T8317 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
> [junit4] 2> 2941684 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2941688 T8336 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 2941689 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 2941690 T8323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 2942663 T8337 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
> [junit4] 2> 2942664 T8337 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385746958917/collection1
> [junit4] 2> 2942665 T8337 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4] 2> 2942668 T8337 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4] 2> 2942670 T8337 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
> [junit4] 2> 2942675 T8337 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385746958917/collection1/'
> [junit4] 2> 2942676 T8337 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385746958917/collection1/lib/classes/' to classloader
> [junit4] 2> 2942677 T8337 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385746958917/collection1/lib/README' to classloader
> [junit4] 2> 2942729 T8337 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
> [junit4] 2> 2942775 T8337 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4] 2> 2942779 T8337 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
> [junit4] 2> 2942793 T8337 oass.IndexSchema.readSchema [collection1] Schema name=test
> [junit4] 2> 2943301 T8337 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4] 2> 2943303 T8337 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4] 2> 2943304 T8337 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4] 2> 2943311 T8337 oass.IndexSchema.readSchema default search field in schema is text
> [junit4] 2> 2943315 T8337 oass.IndexSchema.readSchema unique key field: id
> [junit4] 2> 2943353 T8337 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4] 2> 2943360 T8337 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4] 2> 2943367 T8337 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4] 2> 2943371 T8337 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4] 2> 2943372 T8337 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4] 2> 2943372 T8337 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4] 2> 2943377 T8337 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4] 2> 2943377 T8337 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4] 2> 2943378 T8337 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
> [junit4] 2> 2943378 T8337 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385746958917/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty1/
> [junit4] 2> 2943378 T8337 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@52ba638e
> [junit4] 2> 2943384 T8337 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty1
> [junit4] 2> 2943384 T8337 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty1/index/
> [junit4] 2> 2943385 T8337 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty1/index' doesn't exist. Creating new index...
> [junit4] 2> 2943385 T8337 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty1/index
> [junit4] 2> 2943386 T8337 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=44, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
> [junit4] 2> 2943388 T8337 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
> [junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty1/index,segFN=segments_1,generation=1}
> [junit4] 2> 2943389 T8337 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4] 2> 2943396 T8337 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
> [junit4] 2> 2943397 T8337 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
> [junit4] 2> 2943398 T8337 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4] 2> 2943398 T8337 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
> [junit4] 2> 2943399 T8337 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4] 2> 2943399 T8337 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
> [junit4] 2> 2943401 T8337 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4] 2> 2943401 T8337 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4] 2> 2943402 T8337 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
> [junit4] 2> 2943403 T8337 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4] 2> 2943404 T8337 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4] 2> 2943404 T8337 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4] 2> 2943405 T8337 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4] 2> 2943405 T8337 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4] 2> 2943406 T8337 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4] 2> 2943406 T8337 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
> [junit4] 2> 2943412 T8337 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4] 2> 2943416 T8337 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4] 2> 2943416 T8337 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4] 2> 2943417 T8337 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=71.9130859375, floorSegmentMB=1.580078125, forceMergeDeletesPctAllowed=18.740117723346046, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
> [junit4] 2> 2943418 T8337 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
> [junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty1/index,segFN=segments_1,generation=1}
> [junit4] 2> 2943419 T8337 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4] 2> 2943419 T8337 oass.SolrIndexSearcher.<init> Opening Searcher@2c88c837 main
> [junit4] 2> 2943426 T8338 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2c88c837 main{StandardDirectoryReader(segments_1:1:nrt)}
> [junit4] 2> 2943428 T8337 oasc.CoreContainer.registerCore registering core: collection1
> [junit4] 2> 2943428 T8337 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51830/k/ha collection:collection1 shard:shard1
> [junit4] 2> 2943431 T8337 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
> [junit4] 2> 2943456 T8337 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
> [junit4] 2> 2943462 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2943465 T8337 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4] 2> 2943465 T8337 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4] 2> ASYNC NEW_CORE C9505 name=collection1 org.apache.solr.core.SolrCore@3ceb695b url=http://127.0.0.1:51830/k/ha/collection1 node=127.0.0.1:51830_k%2Fha C9505_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:51830/k/ha, core=collection1, node_name=127.0.0.1:51830_k%2Fha}
> [junit4] 2> 2943466 T8337 C9505 P51830 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51830/k/ha/collection1/
> [junit4] 2> 2943467 T8337 C9505 P51830 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4] 2> 2943467 T8337 C9505 P51830 oasc.SyncStrategy.syncToMe http://127.0.0.1:51830/k/ha/collection1/ has no replicas
> [junit4] 2> 2943468 T8337 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51830/k/ha/collection1/ shard1
> [junit4] 2> 2943469 T8337 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
> [junit4] 2> 2943469 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 2943485 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2943488 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 2943489 T8323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 2943490 T8336 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 2943510 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 2943520 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2943627 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 2943628 T8323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 2943628 T8336 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 2943660 T8337 oasc.ZkController.register We are http://127.0.0.1:51830/k/ha/collection1/ and leader is http://127.0.0.1:51830/k/ha/collection1/
> [junit4] 2> 2943661 T8337 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51830/k/ha
> [junit4] 2> 2943661 T8337 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4] 2> 2943661 T8337 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4] 2> 2943662 T8337 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4] 2> 2943664 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2943665 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2943665 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2943672 T8337 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 2943675 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 2943676 T8294 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
> [junit4] 2> 2943677 T8294 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4] 2> 2943677 T8317 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4] 2> "operation":"state",
> [junit4] 2> "state":"active",
> [junit4] 2> "base_url":"http://127.0.0.1:51830/k/ha",
> [junit4] 2> "core":"collection1",
> [junit4] 2> "roles":null,
> [junit4] 2> "node_name":"127.0.0.1:51830_k%2Fha",
> [junit4] 2> "shard":"shard1",
> [junit4] 2> "shard_range":null,
> [junit4] 2> "shard_state":"active",
> [junit4] 2> "shard_parent":null,
> [junit4] 2> "collection":"collection1",
> [junit4] 2> "numShards":"2",
> [junit4] 2> "core_node_name":"core_node1"}
> [junit4] 2> 2943690 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2943799 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 2943800 T8336 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 2943800 T8323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 2943998 T8294 oejs.Server.doStart jetty-8.1.10.v20130312
> [junit4] 2> 2944005 T8294 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51833
> [junit4] 2> 2944006 T8294 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4] 2> 2944007 T8294 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4] 2> 2944007 T8294 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385746962569
> [junit4] 2> 2944008 T8294 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385746962569/'
> [junit4] 2> 2944034 T8294 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385746962569/solr.xml
> [junit4] 2> 2944085 T8294 oasc.CoreContainer.<init> New CoreContainer 858321732
> [junit4] 2> 2944086 T8294 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385746962569/]
> [junit4] 2> 2944087 T8294 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
> [junit4] 2> 2944088 T8294 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4] 2> 2944088 T8294 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4] 2> 2944089 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4] 2> 2944090 T8294 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4] 2> 2944090 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4] 2> 2944091 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4] 2> 2944091 T8294 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4] 2> 2944092 T8294 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4] 2> 2944117 T8294 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
> [junit4] 2> 2944118 T8294 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
> [junit4] 2> 2944118 T8294 oasc.CoreContainer.load Host Name: 127.0.0.1
> [junit4] 2> 2944119 T8294 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51823/solr
> [junit4] 2> 2944119 T8294 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4] 2> 2944121 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 2944126 T8350 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@457b0f99 name:ZooKeeperConnection Watcher:127.0.0.1:51823 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 2944126 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 2944132 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 2944137 T8352 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4caddcdf name:ZooKeeperConnection Watcher:127.0.0.1:51823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 2944137 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 2944150 T8294 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4] 2> 2945162 T8294 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51833_k%2Fha
> [junit4] 2> 2945166 T8294 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51833_k%2Fha
> [junit4] 2> 2945179 T8323 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4] 2> 2945180 T8352 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4] 2> 2945182 T8316 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4] 2> 2945183 T8336 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4] 2> 2945196 T8353 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4] 2> 2945197 T8353 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4] 2> 2945200 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2945200 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2945200 T8353 oasc.ZkController.waitForCoreNodeName look for our core node name
> [junit4] 2> 2945200 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2945207 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 2945210 T8317 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4] 2> "operation":"state",
> [junit4] 2> "state":"down",
> [junit4] 2> "base_url":"http://127.0.0.1:51833/k/ha",
> [junit4] 2> "core":"collection1",
> [junit4] 2> "roles":null,
> [junit4] 2> "node_name":"127.0.0.1:51833_k%2Fha",
> [junit4] 2> "shard":null,
> [junit4] 2> "shard_range":null,
> [junit4] 2> "shard_state":"active",
> [junit4] 2> "shard_parent":null,
> [junit4] 2> "collection":"collection1",
> [junit4] 2> "numShards":"2",
> [junit4] 2> "core_node_name":null}
> [junit4] 2> 2945210 T8317 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
> [junit4] 2> 2945211 T8317 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
> [junit4] 2> 2945220 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2945330 T8336 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 2945331 T8323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 2945332 T8352 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 2945331 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 2946206 T8353 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
> [junit4] 2> 2946206 T8353 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385746962569/collection1
> [junit4] 2> 2946207 T8353 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4] 2> 2946209 T8353 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4] 2> 2946209 T8353 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
> [junit4] 2> 2946213 T8353 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385746962569/collection1/'
> [junit4] 2> 2946214 T8353 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385746962569/collection1/lib/classes/' to classloader
> [junit4] 2> 2946215 T8353 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385746962569/collection1/lib/README' to classloader
> [junit4] 2> 2946261 T8353 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
> [junit4] 2> 2946307 T8353 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4] 2> 2946311 T8353 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
> [junit4] 2> 2946319 T8353 oass.IndexSchema.readSchema [collection1] Schema name=test
> [junit4] 2> 2946805 T8353 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4] 2> 2946806 T8353 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4] 2> 2946807 T8353 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4] 2> 2946815 T8353 oass.IndexSchema.readSchema default search field in schema is text
> [junit4] 2> 2946820 T8353 oass.IndexSchema.readSchema unique key field: id
> [junit4] 2> 2946865 T8353 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4] 2> 2946872 T8353 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4] 2> 2946879 T8353 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4] 2> 2946884 T8353 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4] 2> 2946884 T8353 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4] 2> 2946885 T8353 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4] 2> 2946889 T8353 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4] 2> 2946889 T8353 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4] 2> 2946890 T8353 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
> [junit4] 2> 2946890 T8353 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385746962569/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty2/
> [junit4] 2> 2946891 T8353 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@52ba638e
> [junit4] 2> 2946892 T8353 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty2
> [junit4] 2> 2946892 T8353 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty2/index/
> [junit4] 2> 2946893 T8353 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty2/index' doesn't exist. Creating new index...
> [junit4] 2> 2946894 T8353 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty2/index
> [junit4] 2> 2946894 T8353 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=44, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
> [junit4] 2> 2946898 T8353 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
> [junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty2/index,segFN=segments_1,generation=1}
> [junit4] 2> 2946898 T8353 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4] 2> 2946902 T8353 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
> [junit4] 2> 2946903 T8353 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
> [junit4] 2> 2946903 T8353 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4] 2> 2946904 T8353 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
> [junit4] 2> 2946904 T8353 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4] 2> 2946905 T8353 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
> [junit4] 2> 2946905 T8353 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4] 2> 2946906 T8353 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4] 2> 2946906 T8353 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
> [junit4] 2> 2946907 T8353 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4] 2> 2946908 T8353 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4] 2> 2946908 T8353 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4] 2> 2946909 T8353 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4] 2> 2946909 T8353 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4] 2> 2946910 T8353 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4] 2> 2946910 T8353 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
> [junit4] 2> 2946918 T8353 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4] 2> 2946922 T8353 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4] 2> 2946922 T8353 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4] 2> 2946923 T8353 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=71.9130859375, floorSegmentMB=1.580078125, forceMergeDeletesPctAllowed=18.740117723346046, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
> [junit4] 2> 2946925 T8353 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
> [junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385746955582/jetty2/index,segFN=segments_1,generation=1}
> [junit4] 2> 2946925 T8353 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4] 2> 2946925 T8353 oass.SolrIndexSearcher.<init> Opening Searcher@5ca190f4 main
> [junit4] 2> 2946932 T8354 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5ca190f4 main{StandardDirectoryReader(segments_1:1:nrt)}
> [junit4] 2> 2946935 T8353 oasc.CoreContainer.registerCore registering core: collection1
> [junit4] 2> 2946935 T8353 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51833/k/ha collection:collection1 shard:shard2
> [junit4] 2> 2946938 T8353 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
> [junit4] 2> 2946960 T8353 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
> [junit4] 2> 2946967 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2946972 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2946972 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2946974 T8353 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4] 2> 2946975 T8353 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4] 2> ASYNC NEW_CORE C9506 name=collection1 org.apache.solr.core.SolrCore@28081eb9 url=http://127.0.0.1:51833/k/ha/collection1 node=127.0.0.1:51833_k%2Fha C9506_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:51833/k/ha, core=collection1, node_name=127.0.0.1:51833_k%2Fha}
> [junit4] 2> 2946975 T8353 C9506 P51833 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51833/k/ha/collection1/
> [junit4] 2> 2946976 T8353 C9506 P51833 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4] 2> 2946976 T8353 C9506 P51833 oasc.SyncStrategy.syncToMe http://127.0.0.1:51833/k/ha/collection1/ has no replicas
> [junit4] 2> 2946976 T8353 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51833/k/ha/collection1/ shard2
> [junit4] 2> 2946977 T8353 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
> [junit4] 2> 2946977 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 2946997 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2947000 T8323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 2947000 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 2947001 T8352 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 2947000 T8336 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 2947025 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 2947035 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2947142 T8323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 2947143 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 2947144 T8352 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 2947144 T8336 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 2947179 T8353 oasc.ZkController.register We are http://127.0.0.1:51833/k/ha/collection1/ and leader is http://127.0.0.1:51833/k/ha/collection1/
> [junit4] 2> 2947179 T8353 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51833/k/ha
> [junit4] 2> 2947180 T8353 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4] 2> 2947180 T8353 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4] 2> 2947180 T8353 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4] 2> 2947182 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2947182 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2947183 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2947184 T8353 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 2947192 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 2947192 T8294 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
> [junit4] 2> 2947193 T8294 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4] 2> 2947194 T8317 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4] 2> "operation":"state",
> [junit4] 2> "state":"active",
> [junit4] 2> "base_url":"http://127.0.0.1:51833/k/ha",
> [junit4] 2> "core":"collection1",
> [junit4] 2> "roles":null,
> [junit4] 2> "node_name":"127.0.0.1:51833_k%2Fha",
> [junit4] 2> "shard":"shard2",
> [junit4] 2> "shard_range":null,
> [junit4] 2> "shard_state":"active",
> [junit4] 2> "shard_parent":null,
> [junit4] 2> "collection":"collection1",
> [junit4] 2> "numShards":"2",
> [junit4] 2> "core_node_name":"core_node2"}
> [junit4] 2> 2947203 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2947313 T8323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 2947318 T8352 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 2947322 T8336 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 2947323 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 2947509 T8294 oejs.Server.doStart jetty-8.1.10.v20130312
> [junit4] 2> 2947514 T8294 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51836
> [junit4] 2> 2947515 T8294 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4] 2> 2947517 T8294 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4] 2> 2947518 T8294 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385746966084
> [junit4] 2> 2947519 T8294 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385746966084/'
> [junit4] 2> 2947552 T8294 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385746966084/solr.xml
> [junit4] 2> 2947610 T8294 oasc.CoreContainer.<init> New CoreContainer 725054923
> [junit4] 2> 2947611 T8294 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385746966084/]
> [junit4] 2> 2947613 T8294 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
> [junit4] 2> 2947613 T8294 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4] 2> 2947614 T8294 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4] 2> 2947614 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4] 2> 2947614 T8294 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4] 2> 2947615 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4] 2> 2947616 T8294 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4] 2> 2947617 T8294 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4] 2> 2947618 T8294 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4] 2> 2947649 T8294 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
> [junit4] 2> 2947650 T8294 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
> [junit4] 2> 2947651 T8294 oasc.CoreContainer.load Host Name: 127.0.0.1
> [junit4] 2> 2947651 T8294 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51823/solr
> [junit4] 2> 2947652 T8294 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4] 2> 2947653 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 2947659 T8366 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@46167897 name:ZooKeeperConnection Watcher:127.0.0.1:51823 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 2947659 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 2947666 T8294 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 2947671 T8368 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d307784 name:ZooKeeperConnection Watcher:127.0.0.1:51823/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 2947672 T8294 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 2947686 T8294 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4] 2> 2948698 T8294 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51836_k%2Fha
> [junit4] 2> 2948701 T8294 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51836_k%2Fha
> [junit4] 2> 2948714 T8316 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4] 2> 2948717 T8368 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4] 2> 2948717 T8336 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4] 2> 2948721 T8352 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4] 2> 2948722 T8323 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4] 2> 2948740 T8369 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4] 2> 2948741 T8369 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4] 2> 2948744 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2948744 T8369 oasc.ZkController.waitForCoreNodeName look for our core node name
> [junit4] 2> 2948744 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2948745 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2948750 T8317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 2948752 T8317 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4] 2> "operation":"state",
> [junit4] 2> "state":"down",
> [junit4] 2> "base_url":"http://127.0.0.1:51836/k/ha",
> [junit4] 2> "core":"collection1",
> [junit4] 2> "roles":null,
> [junit4] 2> "node_name":"127.0.0.1:51836_k%2Fha",
> [junit4] 2> "shard":null,
> [junit4] 2> "shard_range":null,
> [junit4] 2> "shard_state":"active",
> [junit4] 2> "shard_parent":null,
> [junit4] 2> "collection":"collection1",
> [junit4] 2> "numShards":"2",
> [junit4] 2> "core_node_name":null}
> [junit4] 2> 2948752 T8317 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
> [junit4] 2> 2948753 T8317 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
> [junit4] 2> 2948761 T8316 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 2948870 T8352 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4] 2> 2948870 T8368 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4] 2> 2948871 T8336 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4] 2> 2948871 T8316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4] 2> 2948873 T8323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes siz
>
> [...truncated too long message...]
>
> [junit4] FAILURE 99.4s | ChaosMonkeyNothingIsSafeTest.testDistribSearch <<<
> [junit4] > Throwable #1: java.lang.AssertionError: There were expected update fails expected:<0> but was:<1>
> [junit4] > at __randomizedtesting.SeedInfo.seed([A450BDCAE447023A:25B633D293186206]:0)
> [junit4] > at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.doTest(ChaosMonkeyNothingIsSafeTest.java:191)
> [junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:843)
> [junit4] > at java.lang.Thread.run(Thread.java:695)
> [junit4] 2> 3036108 T8294 oas.SolrTestCaseJ4.deleteCore ###deleteCore
> [junit4] 2> 99435 T8293 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
> [junit4] 2> 3036282 T8421 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
> [junit4] 2> 3037378 T8439 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
> [junit4] 2> NOTE: test params are: codec=Lucene46: {timestamp=PostingsFormat(name=TestBloomFilteredLucene41Postings), range_facet_l=PostingsFormat(name=TestBloomFilteredLucene41Postings), id=PostingsFormat(name=MockSep), range_facet_sl=PostingsFormat(name=MockSep), a_t=PostingsFormat(name=TestBloomFilteredLucene41Postings), text=PostingsFormat(name=Direct), range_facet_si=PostingsFormat(name=TestBloomFilteredLucene41Postings), _version_=PostingsFormat(name=MockRandom), other_tl1=PostingsFormat(name=MockRandom), multiDefault=PostingsFormat(name=TestBloomFilteredLucene41Postings), a_si=PostingsFormat(name=MockRandom), intDefault=PostingsFormat(name=MockRandom)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=ar_QA, timezone=Asia/Dhaka
> [junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Apple Inc. 1.6.0_65 (64-bit)/cpus=2,threads=3,free=271035496,total=532545536
> [junit4] 2> NOTE: All tests run in this JVM: [TestUtils, PluginInfoTest, CircularListTest, FileBasedSpellCheckerTest, PrimUtilsTest, TestSolrXmlPersistor, TestBM25SimilarityFactory, TestSolrQueryParser, TestIndexSearcher, TestCustomSort, CachingDirectoryFactoryTest, BinaryUpdateRequestHandlerTest, SystemInfoHandlerTest, JSONWriterTest, CopyFieldTest, TestValueSourceCache, DisMaxRequestHandlerTest, TestQueryTypes, TestDFRSimilarityFactory, ModifyConfFileTest, BJQParserTest, TestSimpleQParserPlugin, InfoHandlerTest, TestCharFilters, SuggesterFSTTest, RequiredFieldsTest, LoggingHandlerTest, TestBadConfig, SuggesterWFSTTest, TestSolrXmlPersistence, MBeansHandlerTest, StressHdfsTest, DirectUpdateHandlerOptimizeTest, ExternalFileFieldSortTest, TestRangeQuery, TestSystemIdResolver, NotRequiredUniqueKeyTest, SOLR749Test, TestHighFrequencyDictionaryFactory, TestPartialUpdateDeduplication, TestFieldTypeResource, TestFiltering, TestSolrQueryParserResource, EchoParamsTest, AnalysisAfterCoreReloadTest, TestDefaultSearchFieldResource, TestStressUserVersions, TestAtomicUpdateErrorCases, SuggesterTSTTest, SignatureUpdateProcessorFactoryTest, TestGroupingSearch, TestPHPSerializedResponseWriter, TestMergePolicyConfig, BadComponentTest, HdfsRecoveryZkTest, UniqFieldsUpdateProcessorFactoryTest, FastVectorHighlighterTest, TestSolrDeletionPolicy1, CoreContainerCoreInitFailuresTest, CollectionsAPIDistributedZkTest, TriLevelCompositeIdRoutingTest, TestSolrDeletionPolicy2, TestRecovery, SortByFunctionTest, TestSchemaResource, CacheHeaderTest, ClusterStateUpdateTest, DebugComponentTest, StatelessScriptUpdateProcessorFactoryTest, TestSolrXMLSerializer, OverseerCollectionProcessorTest, TestDocBasedVersionConstraints, FullSolrCloudDistribCmdsTest, TermVectorComponentTest, ReturnFieldsTest, TestDistribDocBasedVersion, TestModifyConfFiles, TestSurroundQueryParser, TestShardHandlerFactory, TestDistributedSearch, AddBlockUpdateTest, AddSchemaFieldsUpdateProcessorFactoryTest, SpellingQueryConverterTest, TestFuzzyAnalyzedSuggestions, SchemaVersionSpecificBehaviorTest, SolrIndexSplitterTest, DistributedDebugComponentTest, TestComponentsName, TestClassNameShortening, SpellCheckCollatorTest, CoreAdminHandlerTest, TestFaceting, BlockDirectoryTest, TestOmitPositions, DOMUtilTest, SuggestComponentTest, OutputWriterTest, TestQuerySenderListener, HdfsBasicDistributedZk2Test, HdfsCollectionsAPIDistributedZkTest, DeleteShardTest, TestSerializedLuceneMatchVersion, OpenCloseCoreStressTest, TestCoreContainer, HardAutoCommitTest, BlockCacheTest, TestQuerySenderNoQuery, TestPhraseSuggestions, PreAnalyzedFieldTest, HdfsBasicDistributedZkTest, TestIndexingPerformance, TestBinaryField, TestMultiCoreConfBootstrap, ShardRoutingCustomTest, HighlighterTest, TestHashPartitioner, HdfsDirectoryTest, TestDistributedMissingSort, HdfsChaosMonkeySafeLeaderTest, TestRealTimeGet, AssignTest, RecoveryZkTest, TestPseudoReturnFields, DistributedQueryElevationComponentTest, TestImplicitCoreProperties, StandardRequestHandlerTest, TestConfig, TestFieldResource, UnloadDistributedZkTest, TestLazyCores, SyncSliceTest, TestXIncludeConfig, TestReversedWildcardFilterFactory, TestWordDelimiterFilterFactory, CSVRequestHandlerTest, UUIDFieldTest, TestCSVLoader, TestFileDictionaryLookup, SliceStateUpdateTest, LegacyHTMLStripCharFilterTest, FileUtilsTest, ResponseLogComponentTest, ShowFileRequestHandlerTest, TestSchemaSimilarityResource, TestSweetSpotSimilarityFactory, TestSolrIndexConfig, DateFieldTest, TestAnalyzeInfixSuggestions, ResourceLoaderTest, PreAnalyzedUpdateProcessorTest, DocumentAnalysisRequestHandlerTest, TestSolrJ, XmlUpdateRequestHandlerTest, SolrTestCaseJ4Test, PeerSyncTest, TestNRTOpen, TestJmxMonitoredMap, TestFieldCollectionResource, DistributedSuggesterComponentTest, TestRandomMergePolicy, TermsComponentTest, TestStressReorder, ShardRoutingTest, TestDocumentBuilder, DocValuesMultiTest, DeleteInactiveReplicaTest, TestFastOutputStream, QueryParsingTest, TestPostingsSolrHighlighter, TestInfoStreamLogging, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, OverseerTest, LeaderElectionIntegrationTest, BasicZkTest, TestReplicationHandler, TestRandomFaceting, LeaderElectionTest, ZkSolrClientTest, TestZkChroot, TestRandomDVFaceting, ZkCLITest, AutoCommitTest, TestDistributedGrouping, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, ZkControllerTest, TestJoin, TestReload, TestStressVersions, DistributedTermsComponentTest, SimpleFacetsTest, TestSolr4Spatial, SolrCoreTest, StatsComponentTest, SpellCheckComponentTest, SolrCmdDistributorTest, QueryElevationComponentTest, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestFunctionQuery, BasicFunctionalityTest, DirectUpdateHandlerTest, SoftAutoCommitTest, CurrencyFieldOpenExchangeTest, CurrencyFieldXmlFileTest, SimplePostToolTest, TestCoreDiscovery, TestExtendedDismaxParser, SolrRequestParserTest, TestFoldingMultitermQuery, DocValuesTest, SuggesterTest, TestStressLucene, TestTrie, SpatialFilterTest, PolyFieldTest, NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, SolrCoreCheckLockOnStartupTest, TestUpdate, FieldMutatingUpdateProcessorTest, QueryEqualityTest, DefaultValueUpdateProcessorTest, TestRemoteStreaming, DistanceFunctionTest, SolrInfoMBeanTest, XsltUpdateRequestHandlerTest, IndexBasedSpellCheckerTest, LukeRequestHandlerTest, TestQueryUtils, TestWriterPerf, DirectSolrSpellCheckerTest, PrimitiveFieldTypeTest, RequestHandlersTest, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, TestArbitraryIndexDir, IndexSchemaRuntimeFieldTest, RegexBoostProcessorTest, SolrPluginUtilsTest, IndexSchemaTest, TestJmxIntegration, TestCollationField, UpdateRequestProcessorFactoryTest, TestCSVResponseWriter, TestAnalyzedSuggestions, JsonLoaderTest, PingRequestHandlerTest, SearchHandlerTest, TestBinaryResponseWriter, TestLFUCache, HighlighterConfigTest, UpdateParamsTest, AlternateDirectoryTest, SolrIndexConfigTest, TestStressRecovery, MultiTermTest, SampleTest, TestDocSet, TestSearchPerf, NumericFieldsTest, MinimalSchemaTest, TestElisionMultitermQuery, TestSolrCoreProperties, DirectSolrConnectionTest, TestLuceneMatchVersion, SpellPossibilityIteratorTest, TestCodecSupport, SynonymTokenizerTest, TestPerFieldSimilarity, TestNumberUtils, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestIBSimilarityFactory, TestDefaultSimilarityFactory, TestFastWriter, TimeZoneUtilsTest, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, TestFastLRUCache, DateMathParserTest, ChaosMonkeyNothingIsSafeTest]
> [junit4] Completed in 100.76s, 1 test, 1 failure <<< FAILURES!
>
> [...truncated 177 lines...]
> BUILD FAILED
> /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:426: The following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:406: The following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:39: The following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/extra-targets.xml:37: The following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build.xml:189: The following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/common-build.xml:491: The following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:1279: The following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:912: There were test failures: 349 suites, 1516 tests, 1 failure, 39 ignored (5 assumptions)
>
> Total time: 94 minutes 25 seconds
> Build step 'Invoke Ant' marked build as failure
> Description set: Java: 64bit/jdk1.6.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org