You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/11/30 15:06:55 UTC
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4512 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4512/
1 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.testDistribSearch
Error Message:
There were expected update fails expected:<0> but was:<1>
Stack Trace:
java.lang.AssertionError: There were expected update fails expected:<0> but was:<1>
at __randomizedtesting.SeedInfo.seed([AD0406FE1985AAE8:2CE288E66EDACAD4]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.doTest(ChaosMonkeyNothingIsSafeTest.java:191)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:843)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
Build Log:
[...truncated 10399 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
[junit4] 2> 817135 T1640 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /jn_/r
[junit4] 2> 817142 T1640 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./solrtest-ChaosMonkeyNothingIsSafeTest-1385818979448
[junit4] 2> 817143 T1640 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 817144 T1641 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 817245 T1640 oasc.ZkTestServer.run start zk server on port:45316
[junit4] 2> 817246 T1640 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 817251 T1647 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5a494011 name:ZooKeeperConnection Watcher:127.0.0.1:45316 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 817251 T1640 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 817252 T1640 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 817257 T1640 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 817259 T1649 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@21c38aa8 name:ZooKeeperConnection Watcher:127.0.0.1:45316/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 817259 T1640 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 817260 T1640 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 817272 T1640 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 817275 T1640 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 817278 T1640 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 817287 T1640 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 817287 T1640 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 817293 T1640 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 817294 T1640 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 817399 T1640 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 817399 T1640 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 817403 T1640 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 817404 T1640 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 817412 T1640 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 817413 T1640 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 817417 T1640 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 817417 T1640 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 817421 T1640 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 817421 T1640 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 817425 T1640 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 817426 T1640 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 817429 T1640 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 817430 T1640 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 817433 T1640 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 817434 T1640 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 817437 T1640 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 817438 T1640 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 817759 T1640 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 817764 T1640 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:45319
[junit4] 2> 817765 T1640 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 817765 T1640 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 817766 T1640 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385818979748
[junit4] 2> 817766 T1640 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385818979748/'
[junit4] 2> 817815 T1640 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385818979748/solr.xml
[junit4] 2> 817918 T1640 oasc.CoreContainer.<init> New CoreContainer 902628762
[junit4] 2> 817919 T1640 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385818979748/]
[junit4] 2> 817921 T1640 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 817922 T1640 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 817922 T1640 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 817923 T1640 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 817923 T1640 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 817923 T1640 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 817924 T1640 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 817924 T1640 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 817925 T1640 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 817947 T1640 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 817947 T1640 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 817948 T1640 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 817948 T1640 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45316/solr
[junit4] 2> 817949 T1640 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 817950 T1640 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 817953 T1660 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7841becb name:ZooKeeperConnection Watcher:127.0.0.1:45316 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 817954 T1640 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 817957 T1640 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 817959 T1662 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@250b8036 name:ZooKeeperConnection Watcher:127.0.0.1:45316/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 817959 T1640 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 817968 T1640 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 817973 T1640 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 817982 T1640 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 817985 T1640 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45319_jn_%2Fr
[junit4] 2> 817987 T1640 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45319_jn_%2Fr
[junit4] 2> 817997 T1640 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 818011 T1640 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 818014 T1640 oasc.Overseer.start Overseer (id=90821032637628419-127.0.0.1:45319_jn_%2Fr-n_0000000000) starting
[junit4] 2> 818024 T1640 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 818035 T1664 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 818036 T1640 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 818039 T1640 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 818042 T1640 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 818045 T1663 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 818052 T1665 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 818052 T1665 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 818054 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 818054 T1665 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 818055 T1663 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 818056 T1663 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:45319/jn_/r",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:45319_jn_%2Fr",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 818056 T1663 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 818057 T1663 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 818060 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 818069 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 819055 T1665 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 819055 T1665 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385818979748/collection1
[junit4] 2> 819056 T1665 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 819057 T1665 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 819057 T1665 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 819058 T1665 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385818979748/collection1/'
[junit4] 2> 819060 T1665 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385818979748/collection1/lib/classes/' to classloader
[junit4] 2> 819061 T1665 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385818979748/collection1/lib/README' to classloader
[junit4] 2> 819133 T1665 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 819205 T1665 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 819307 T1665 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 819320 T1665 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 820008 T1665 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 820024 T1665 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 820029 T1665 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 820047 T1665 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 820053 T1665 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 820058 T1665 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 820059 T1665 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 820060 T1665 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 820060 T1665 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 820061 T1665 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 820062 T1665 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 820062 T1665 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 820063 T1665 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385818979748/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/control/data/
[junit4] 2> 820063 T1665 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a62d3b6
[junit4] 2> 820065 T1665 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/control/data
[junit4] 2> 820066 T1665 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/control/data/index/
[junit4] 2> 820067 T1665 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 820069 T1665 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/control/data/index
[junit4] 2> 820069 T1665 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=11.755859375, floorSegmentMB=0.869140625, forceMergeDeletesPctAllowed=0.6115454266629705, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 820074 T1665 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 820075 T1665 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 820079 T1665 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 820080 T1665 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 820080 T1665 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 820081 T1665 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 820081 T1665 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 820081 T1665 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 820082 T1665 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 820082 T1665 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 820083 T1665 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 820083 T1665 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 820084 T1665 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 820084 T1665 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 820084 T1665 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 820085 T1665 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 820086 T1665 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 820086 T1665 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 820105 T1665 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 820110 T1665 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 820110 T1665 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 820111 T1665 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=35, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5075254677637961]
[junit4] 2> 820113 T1665 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 820114 T1665 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 820114 T1665 oass.SolrIndexSearcher.<init> Opening Searcher@4dce2622 main
[junit4] 2> 820118 T1666 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4dce2622 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 820121 T1665 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 820121 T1665 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45319/jn_/r collection:control_collection shard:shard1
[junit4] 2> 820122 T1665 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 820143 T1665 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 820146 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 820147 T1665 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 820148 T1665 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C613 name=collection1 org.apache.solr.core.SolrCore@c6dd2ae url=http://127.0.0.1:45319/jn_/r/collection1 node=127.0.0.1:45319_jn_%2Fr C613_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:45319/jn_/r, core=collection1, node_name=127.0.0.1:45319_jn_%2Fr}
[junit4] 2> 820148 T1665 C613 P45319 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45319/jn_/r/collection1/
[junit4] 2> 820148 T1663 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 820159 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 820160 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 821649 T1665 C613 P45319 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 821649 T1665 C613 P45319 oasc.SyncStrategy.syncToMe http://127.0.0.1:45319/jn_/r/collection1/ has no replicas
[junit4] 2> 821650 T1665 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45319/jn_/r/collection1/ shard1
[junit4] 2> 821650 T1665 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 821665 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 821667 T1663 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 821671 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 821681 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 821717 T1665 oasc.ZkController.register We are http://127.0.0.1:45319/jn_/r/collection1/ and leader is http://127.0.0.1:45319/jn_/r/collection1/
[junit4] 2> 821717 T1665 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45319/jn_/r
[junit4] 2> 821717 T1665 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 821718 T1665 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 821718 T1665 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 821720 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 821721 T1665 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 821722 T1640 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4] 2> 821723 T1640 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 821722 T1663 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 821724 T1663 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:45319/jn_/r",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:45319_jn_%2Fr",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 821726 T1640 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 821728 T1669 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2dcd7847 name:ZooKeeperConnection Watcher:127.0.0.1:45316/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 821729 T1640 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 821737 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 821738 T1640 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 821741 T1640 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 821841 T1669 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 821841 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 822087 T1640 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 822091 T1640 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:45323
[junit4] 2> 822091 T1640 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 822092 T1640 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 822092 T1640 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385818984046
[junit4] 2> 822093 T1640 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385818984046/'
[junit4] 2> 822138 T1640 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385818984046/solr.xml
[junit4] 2> 822244 T1640 oasc.CoreContainer.<init> New CoreContainer 366605701
[junit4] 2> 822245 T1640 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385818984046/]
[junit4] 2> 822247 T1640 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 822247 T1640 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 822248 T1640 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 822248 T1640 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 822249 T1640 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 822249 T1640 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 822250 T1640 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 822250 T1640 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 822250 T1640 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 822269 T1640 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 822270 T1640 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 822270 T1640 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 822271 T1640 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45316/solr
[junit4] 2> 822271 T1640 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 822272 T1640 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 822275 T1680 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@454a07bc name:ZooKeeperConnection Watcher:127.0.0.1:45316 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 822276 T1640 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 822279 T1640 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 822286 T1682 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5946c9e9 name:ZooKeeperConnection Watcher:127.0.0.1:45316/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 822286 T1640 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 822292 T1640 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 823296 T1640 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45323_jn_%2Fr
[junit4] 2> 823299 T1640 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45323_jn_%2Fr
[junit4] 2> 823346 T1669 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 823346 T1682 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 823346 T1662 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 823357 T1683 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 823357 T1683 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 823397 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 823397 T1683 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 823397 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 823397 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 823398 T1663 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 823399 T1663 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:45323/jn_/r",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:45323_jn_%2Fr",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 823400 T1663 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 823400 T1663 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 823450 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 823487 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 823487 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 823487 T1669 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 824398 T1683 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 824398 T1683 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385818984046/collection1
[junit4] 2> 824398 T1683 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 824399 T1683 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 824399 T1683 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 824400 T1683 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385818984046/collection1/'
[junit4] 2> 824402 T1683 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385818984046/collection1/lib/classes/' to classloader
[junit4] 2> 824403 T1683 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385818984046/collection1/lib/README' to classloader
[junit4] 2> 824454 T1683 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 824505 T1683 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 824607 T1683 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 824620 T1683 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 825320 T1683 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 825335 T1683 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 825340 T1683 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 825358 T1683 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 825363 T1683 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 825368 T1683 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 825369 T1683 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 825370 T1683 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 825370 T1683 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 825371 T1683 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 825372 T1683 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 825372 T1683 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 825372 T1683 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385818984046/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/jetty1/
[junit4] 2> 825373 T1683 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a62d3b6
[junit4] 2> 825374 T1683 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/jetty1
[junit4] 2> 825375 T1683 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/jetty1/index/
[junit4] 2> 825376 T1683 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 825377 T1683 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/jetty1/index
[junit4] 2> 825378 T1683 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=11.755859375, floorSegmentMB=0.869140625, forceMergeDeletesPctAllowed=0.6115454266629705, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 825381 T1683 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 825382 T1683 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 825387 T1683 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 825388 T1683 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 825388 T1683 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 825389 T1683 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 825389 T1683 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 825389 T1683 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 825390 T1683 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 825391 T1683 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 825391 T1683 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 825392 T1683 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 825392 T1683 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 825393 T1683 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 825393 T1683 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 825394 T1683 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 825394 T1683 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 825395 T1683 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 825412 T1683 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 825416 T1683 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 825416 T1683 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 825417 T1683 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=35, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5075254677637961]
[junit4] 2> 825419 T1683 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 825420 T1683 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 825420 T1683 oass.SolrIndexSearcher.<init> Opening Searcher@47040ef main
[junit4] 2> 825425 T1684 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@47040ef main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 825428 T1683 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 825429 T1683 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45323/jn_/r collection:collection1 shard:shard2
[junit4] 2> 825430 T1683 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 825447 T1683 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 825450 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 825451 T1683 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 825451 T1683 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C614 name=collection1 org.apache.solr.core.SolrCore@23488dd9 url=http://127.0.0.1:45323/jn_/r/collection1 node=127.0.0.1:45323_jn_%2Fr C614_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:45323/jn_/r, core=collection1, node_name=127.0.0.1:45323_jn_%2Fr}
[junit4] 2> 825451 T1683 C614 P45323 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45323/jn_/r/collection1/
[junit4] 2> 825452 T1663 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 825456 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 825466 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 825466 T1669 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 825466 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 826953 T1683 C614 P45323 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 826953 T1683 C614 P45323 oasc.SyncStrategy.syncToMe http://127.0.0.1:45323/jn_/r/collection1/ has no replicas
[junit4] 2> 826954 T1683 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45323/jn_/r/collection1/ shard2
[junit4] 2> 826954 T1683 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 826975 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 826977 T1663 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 826986 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 826987 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 826987 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 826987 T1669 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 827027 T1683 oasc.ZkController.register We are http://127.0.0.1:45323/jn_/r/collection1/ and leader is http://127.0.0.1:45323/jn_/r/collection1/
[junit4] 2> 827027 T1683 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45323/jn_/r
[junit4] 2> 827027 T1683 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 827027 T1683 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 827028 T1683 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 827029 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 827030 T1683 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 827031 T1663 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 827031 T1640 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4] 2> 827032 T1640 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 827032 T1663 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:45323/jn_/r",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:45323_jn_%2Fr",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 827036 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 827139 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 827139 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 827139 T1669 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 827343 T1640 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 827349 T1640 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:45332
[junit4] 2> 827350 T1640 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 827350 T1640 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 827351 T1640 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385818989338
[junit4] 2> 827351 T1640 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385818989338/'
[junit4] 2> 827390 T1640 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385818989338/solr.xml
[junit4] 2> 827487 T1640 oasc.CoreContainer.<init> New CoreContainer 206536195
[junit4] 2> 827488 T1640 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385818989338/]
[junit4] 2> 827490 T1640 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 827490 T1640 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 827491 T1640 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 827491 T1640 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 827492 T1640 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 827492 T1640 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 827493 T1640 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 827493 T1640 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 827494 T1640 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 827513 T1640 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 827513 T1640 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 827514 T1640 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 827514 T1640 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45316/solr
[junit4] 2> 827515 T1640 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 827516 T1640 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 827519 T1696 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@494258c name:ZooKeeperConnection Watcher:127.0.0.1:45316 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 827520 T1640 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 827529 T1640 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 827532 T1698 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@360af06b name:ZooKeeperConnection Watcher:127.0.0.1:45316/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 827532 T1640 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 827544 T1640 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 828548 T1640 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45332_jn_%2Fr
[junit4] 2> 828554 T1640 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45332_jn_%2Fr
[junit4] 2> 828558 T1662 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 828559 T1682 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 828559 T1698 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 828559 T1669 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 828568 T1699 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 828568 T1699 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 828572 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 828572 T1699 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 828572 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 828573 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 828574 T1663 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 828575 T1663 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:45332/jn_/r",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:45332_jn_%2Fr",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 828575 T1663 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 828575 T1663 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 828585 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 828690 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 828690 T1698 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 828690 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 828690 T1669 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 829573 T1699 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 829573 T1699 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385818989338/collection1
[junit4] 2> 829573 T1699 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 829574 T1699 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 829574 T1699 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 829575 T1699 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385818989338/collection1/'
[junit4] 2> 829577 T1699 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385818989338/collection1/lib/README' to classloader
[junit4] 2> 829578 T1699 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385818989338/collection1/lib/classes/' to classloader
[junit4] 2> 829644 T1699 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 829709 T1699 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 829811 T1699 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 829823 T1699 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 830476 T1699 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 830491 T1699 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 830495 T1699 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 830532 T1699 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 830538 T1699 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 830542 T1699 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 830544 T1699 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 830544 T1699 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 830545 T1699 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 830546 T1699 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 830546 T1699 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 830546 T1699 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 830547 T1699 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385818989338/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/jetty2/
[junit4] 2> 830547 T1699 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a62d3b6
[junit4] 2> 830548 T1699 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/jetty2
[junit4] 2> 830549 T1699 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/jetty2/index/
[junit4] 2> 830550 T1699 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 830551 T1699 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/jetty2/index
[junit4] 2> 830552 T1699 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=11.755859375, floorSegmentMB=0.869140625, forceMergeDeletesPctAllowed=0.6115454266629705, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 830556 T1699 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 830556 T1699 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 830562 T1699 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 830562 T1699 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 830563 T1699 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 830563 T1699 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 830563 T1699 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 830563 T1699 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 830564 T1699 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 830564 T1699 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 830565 T1699 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 830565 T1699 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 830566 T1699 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 830566 T1699 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 830567 T1699 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 830567 T1699 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 830568 T1699 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 830569 T1699 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 830584 T1699 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 830588 T1699 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 830588 T1699 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 830589 T1699 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=35, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5075254677637961]
[junit4] 2> 830591 T1699 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 830591 T1699 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 830592 T1699 oass.SolrIndexSearcher.<init> Opening Searcher@610fe0ce main
[junit4] 2> 830596 T1700 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@610fe0ce main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 830599 T1699 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 830599 T1699 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45332/jn_/r collection:collection1 shard:shard1
[junit4] 2> 830600 T1699 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 830617 T1699 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 830627 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 830628 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 830628 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 830628 T1699 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 830628 T1699 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C615 name=collection1 org.apache.solr.core.SolrCore@900ebbb url=http://127.0.0.1:45332/jn_/r/collection1 node=127.0.0.1:45332_jn_%2Fr C615_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:45332/jn_/r, core=collection1, node_name=127.0.0.1:45332_jn_%2Fr}
[junit4] 2> 830629 T1699 C615 P45332 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45332/jn_/r/collection1/
[junit4] 2> 830630 T1663 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 830634 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 830642 T1698 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 830642 T1669 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 830642 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 830642 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 832130 T1699 C615 P45332 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 832130 T1699 C615 P45332 oasc.SyncStrategy.syncToMe http://127.0.0.1:45332/jn_/r/collection1/ has no replicas
[junit4] 2> 832130 T1699 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45332/jn_/r/collection1/ shard1
[junit4] 2> 832131 T1699 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 832146 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 832148 T1663 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 832152 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 832153 T1669 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 832153 T1698 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 832153 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 832153 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 832198 T1699 oasc.ZkController.register We are http://127.0.0.1:45332/jn_/r/collection1/ and leader is http://127.0.0.1:45332/jn_/r/collection1/
[junit4] 2> 832198 T1699 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45332/jn_/r
[junit4] 2> 832198 T1699 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 832198 T1699 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 832199 T1699 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 832200 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 832201 T1699 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 832202 T1663 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 832202 T1640 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4] 2> 832203 T1640 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 832203 T1663 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:45332/jn_/r",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:45332_jn_%2Fr",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 832207 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 832310 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 832310 T1669 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 832310 T1698 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 832310 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 832499 T1640 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 832503 T1640 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:45339
[junit4] 2> 832504 T1640 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 832504 T1640 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 832505 T1640 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385818994509
[junit4] 2> 832505 T1640 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385818994509/'
[junit4] 2> 832547 T1640 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385818994509/solr.xml
[junit4] 2> 832654 T1640 oasc.CoreContainer.<init> New CoreContainer 2090192648
[junit4] 2> 832655 T1640 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385818994509/]
[junit4] 2> 832657 T1640 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 832658 T1640 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 832658 T1640 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 832659 T1640 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 832659 T1640 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 832660 T1640 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 832660 T1640 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 832661 T1640 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 832661 T1640 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 832680 T1640 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 832681 T1640 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 832681 T1640 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 832682 T1640 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45316/solr
[junit4] 2> 832682 T1640 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 832683 T1640 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 832686 T1712 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5df9d402 name:ZooKeeperConnection Watcher:127.0.0.1:45316 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 832687 T1640 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 832697 T1640 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 832699 T1714 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@606d4b51 name:ZooKeeperConnection Watcher:127.0.0.1:45316/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 832700 T1640 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 832710 T1640 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 833714 T1640 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45339_jn_%2Fr
[junit4] 2> 833717 T1640 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45339_jn_%2Fr
[junit4] 2> 833721 T1669 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 833721 T1714 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 833721 T1682 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 833721 T1662 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 833721 T1698 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 833739 T1715 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 833739 T1715 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 833741 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 833741 T1715 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 833741 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 833742 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 833743 T1663 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 833744 T1663 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:45339/jn_/r",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:45339_jn_%2Fr",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 833744 T1663 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 833745 T1663 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 833748 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 833851 T1714 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 833851 T1669 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 833851 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 833851 T1698 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 833851 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 834742 T1715 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 834742 T1715 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385818994509/collection1
[junit4] 2> 834742 T1715 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 834743 T1715 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 834744 T1715 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 834745 T1715 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385818994509/collection1/'
[junit4] 2> 834746 T1715 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385818994509/collection1/lib/README' to classloader
[junit4] 2> 834747 T1715 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385818994509/collection1/lib/classes/' to classloader
[junit4] 2> 834814 T1715 oasc.SolrConfig.<in
[...truncated too long message...]
.java:724)
[junit4] 2> Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to 127.0.0.1:45352 timed out
[junit4] 2> at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:129)
[junit4] 2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
[junit4] 2> at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
[junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:643)
[junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:479)
[junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
[junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
[junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:393)
[junit4] 2> ... 11 more
[junit4] 2> Caused by: java.net.SocketTimeoutException: connect timed out
[junit4] 2> at java.net.PlainSocketImpl.socketConnect(Native Method)
[junit4] 2> at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
[junit4] 2> at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
[junit4] 2> at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
[junit4] 2> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
[junit4] 2> at java.net.Socket.connect(Socket.java:579)
[junit4] 2> at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
[junit4] 2> ... 19 more
[junit4] 2>
[junit4] 2> 977893 T1884 C658 P45366 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:45366/jn_/r DONE. sync failed
[junit4] 2> 977893 T1884 C658 P45366 oasc.SyncStrategy.syncReplicas We have been closed, won't attempt to sync replicas back to leader
[junit4] 2> 977894 T1884 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 977895 T1884 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@51c69e5f
[junit4] 2> 977905 T1884 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=3,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=33,cumulative_deletesById=15,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=2}
[junit4] 2> 977905 T1884 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 977905 T1884 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 977905 T1884 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 977907 T1884 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 977908 T1884 oasc.CachingDirectoryFactory.close Closing StandardDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 977909 T1884 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/jetty7 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/jetty7;done=false>>]
[junit4] 2> 977909 T1884 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/jetty7
[junit4] 2> 977909 T1884 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/jetty7/index [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/jetty7/index;done=false>>]
[junit4] 2> 977909 T1884 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385818979447/jetty7/index
[junit4] 2> 977910 T1884 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 977910 T1884 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 977910 T1884 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 977910 T1884 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:252)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:249)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:249)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:93)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:138)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> NOTE: test params are: codec=Lucene40, sim=DefaultSimilarity, locale=pl_PL, timezone=Asia/Macau
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=3,free=364218584,total=533725184
[junit4] 2> NOTE: All tests run in this JVM: [BadCopyFieldTest, StressHdfsTest, ChaosMonkeySafeLeaderTest, DirectUpdateHandlerTest, TestStressLucene, MigrateRouteKeyTest, TestAddFieldRealTimeGet, NumericFieldsTest, FieldFacetExtrasTest, OpenCloseCoreStressTest, HdfsDirectoryTest, TestJmxIntegration, HardAutoCommitTest, TestDefaultSearchFieldResource, StandardRequestHandlerTest, RequiredFieldsTest, TestSerializedLuceneMatchVersion, TestCodecSupport, TestSchemaNameResource, TestAtomicUpdateErrorCases, TestRandomMergePolicy, FieldAnalysisRequestHandlerTest, CachingDirectoryFactoryTest, TestCollationField, FieldFacetTest, TestDFRSimilarityFactory, TestSimpleQParserPlugin, TestInfoStreamLogging, ModifyConfFileTest, ExpressionTest, DocumentAnalysisRequestHandlerTest, RangeFacetTest, StatsComponentTest, NotRequiredUniqueKeyTest, TestQuerySenderListener, SolrIndexConfigTest, TestStressUserVersions, TestCustomSort, TestFieldTypeResource, TestQuerySenderNoQuery, TestCoreDiscovery, TestCSVResponseWriter, DeleteInactiveReplicaTest, HighlighterTest, CurrencyFieldOpenExchangeTest, TestImplicitCoreProperties, TestDynamicFieldResource, DateFieldTest, TestSolrXml, TestDistributedGrouping, IndexSchemaRuntimeFieldTest, TestFieldResource, UniqFieldsUpdateProcessorFactoryTest, TestFieldTypeCollectionResource, TestDistributedSearch, BasicDistributedZk2Test, MinimalSchemaTest, ChangedSchemaMergeTest, TestStressRecovery, BadIndexSchemaTest, HighlighterConfigTest, TestPartialUpdateDeduplication, ChaosMonkeyNothingIsSafeTest]
[junit4] Completed on J1 in 161.73s, 1 test, 1 failure <<< FAILURES!
[...truncated 668 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:420: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:400: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/common-build.xml:491: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1275: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:908: There were test failures: 357 suites, 1569 tests, 1 failure, 34 ignored (6 assumptions)
Total time: 62 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4515 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4515/
All tests passed
Build Log:
[...truncated 58605 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:420: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:359: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/extra-targets.xml:87: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/extra-targets.xml:158: Source checkout is dirty after running tests!!! Offending files:
* ./solr/licenses/jackson-core-asl-1.7.4.jar.sha1
* ./solr/licenses/jackson-mapper-asl-1.7.4.jar.sha1
* ./solr/licenses/jersey-core-1.16.jar.sha1
Total time: 115 minutes 45 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4514 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4514/
1 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.testDistribSearch
Error Message:
There were expected update fails expected:<0> but was:<1>
Stack Trace:
java.lang.AssertionError: There were expected update fails expected:<0> but was:<1>
at __randomizedtesting.SeedInfo.seed([AECDF85261C18C80:2F2B764A169EECBC]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.doTest(ChaosMonkeyNothingIsSafeTest.java:202)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:843)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
Build Log:
[...truncated 10365 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
[junit4] 2> 697610 T748 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 697623 T748 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./solrtest-ChaosMonkeyNothingIsSafeTest-1385956797376
[junit4] 2> 697625 T748 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 697626 T749 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 697726 T748 oasc.ZkTestServer.run start zk server on port:13165
[junit4] 2> 697727 T748 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 697733 T755 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1244e56 name:ZooKeeperConnection Watcher:127.0.0.1:13165 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 697733 T748 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 697734 T748 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 697740 T748 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 697760 T757 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f8dc872 name:ZooKeeperConnection Watcher:127.0.0.1:13165/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 697761 T748 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 697761 T748 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 697810 T748 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 697814 T748 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 697855 T748 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 697860 T748 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 697871 T748 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 697949 T748 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 697959 T748 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 698066 T748 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 698067 T748 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 698071 T748 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 698072 T748 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 698077 T748 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 698078 T748 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 698087 T748 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 698088 T748 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 698095 T748 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 698096 T748 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 698114 T748 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 698115 T748 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 698119 T748 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 698120 T748 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 698129 T748 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 698129 T748 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 698145 T748 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 698146 T748 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 698520 T748 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 698525 T748 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:62288
[junit4] 2> 698526 T748 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 698526 T748 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 698527 T748 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385956797904
[junit4] 2> 698527 T748 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385956797904/'
[junit4] 2> 698569 T748 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385956797904/solr.xml
[junit4] 2> 698679 T748 oasc.CoreContainer.<init> New CoreContainer 967037106
[junit4] 2> 698680 T748 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385956797904/]
[junit4] 2> 698682 T748 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 698682 T748 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 698683 T748 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 698683 T748 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 698684 T748 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 698684 T748 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 698684 T748 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 698685 T748 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 698685 T748 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 698706 T748 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 698706 T748 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 698707 T748 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 698707 T748 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:13165/solr
[junit4] 2> 698708 T748 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 698709 T748 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 698712 T768 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3826a29b name:ZooKeeperConnection Watcher:127.0.0.1:13165 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 698713 T748 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 698716 T748 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 698729 T770 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b87a5a1 name:ZooKeeperConnection Watcher:127.0.0.1:13165/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 698729 T748 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 698732 T748 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 698738 T748 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 698742 T748 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 698749 T748 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62288_
[junit4] 2> 698751 T748 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:62288_
[junit4] 2> 698755 T748 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 698773 T748 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 698776 T748 oasc.Overseer.start Overseer (id=90830064673357827-127.0.0.1:62288_-n_0000000000) starting
[junit4] 2> 698787 T748 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 698800 T772 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 698801 T748 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 698804 T748 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 698807 T748 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 698811 T771 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 698817 T773 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 698817 T773 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 698819 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 698819 T773 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 698821 T771 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 698822 T771 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:62288",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:62288_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 698823 T771 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 698823 T771 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 698826 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 698835 T770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 699821 T773 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 699821 T773 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385956797904/collection1
[junit4] 2> 699821 T773 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 699822 T773 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 699823 T773 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 699824 T773 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385956797904/collection1/'
[junit4] 2> 699825 T773 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385956797904/collection1/lib/README' to classloader
[junit4] 2> 699826 T773 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385956797904/collection1/lib/classes/' to classloader
[junit4] 2> 699892 T773 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 699955 T773 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 700058 T773 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 700069 T773 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 700677 T773 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 700681 T773 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 700684 T773 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 700690 T773 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 700725 T773 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 700781 T773 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385956797904/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/control/data/
[junit4] 2> 700782 T773 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2a2f0d89
[junit4] 2> 700783 T773 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/control/data
[junit4] 2> 700784 T773 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/control/data/index/
[junit4] 2> 700785 T773 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 700787 T773 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/control/data/index
[junit4] 2> 700788 T773 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=29, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=65.7900390625, floorSegmentMB=0.6103515625, forceMergeDeletesPctAllowed=4.994081044040208, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6507784844660305
[junit4] 2> 700812 T773 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 700813 T773 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 700817 T773 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 700818 T773 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 700818 T773 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 700818 T773 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 700819 T773 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 700819 T773 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 700819 T773 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 700820 T773 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 700820 T773 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 700821 T773 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 700821 T773 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 700821 T773 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 700822 T773 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 700822 T773 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 700823 T773 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 700823 T773 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 700840 T773 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 700844 T773 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 700844 T773 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 700845 T773 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=47, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 700847 T773 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 700848 T773 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 700848 T773 oass.SolrIndexSearcher.<init> Opening Searcher@6f028b1c main
[junit4] 2> 700852 T774 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6f028b1c main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 700853 T773 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 700854 T773 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:62288 collection:control_collection shard:shard1
[junit4] 2> 700855 T773 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 700882 T773 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 700896 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 700896 T773 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 700897 T773 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C324 name=collection1 org.apache.solr.core.SolrCore@7d051018 url=http://127.0.0.1:62288/collection1 node=127.0.0.1:62288_ C324_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:62288, core=collection1, node_name=127.0.0.1:62288_}
[junit4] 2> 700897 T773 C324 P62288 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:62288/collection1/
[junit4] 2> 700897 T773 C324 P62288 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 700897 T773 C324 P62288 oasc.SyncStrategy.syncToMe http://127.0.0.1:62288/collection1/ has no replicas
[junit4] 2> 700898 T773 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:62288/collection1/ shard1
[junit4] 2> 700898 T771 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 700898 T773 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 700918 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 700920 T770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 700953 T771 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 700968 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 701072 T770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 701107 T773 oasc.ZkController.register We are http://127.0.0.1:62288/collection1/ and leader is http://127.0.0.1:62288/collection1/
[junit4] 2> 701107 T773 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:62288
[junit4] 2> 701107 T773 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 701108 T773 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 701108 T773 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 701110 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 701111 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 701111 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 701111 T773 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 701113 T748 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4] 2> 701113 T748 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 701113 T771 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 701114 T771 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:62288",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:62288_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 701126 T748 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 701134 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 701136 T777 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3774304c name:ZooKeeperConnection Watcher:127.0.0.1:13165/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 701136 T748 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 701138 T748 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 701141 T748 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 701239 T770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 701239 T777 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 701547 T748 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 701551 T748 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:46819
[junit4] 2> 701551 T748 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 701552 T748 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 701552 T748 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385956800893
[junit4] 2> 701553 T748 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385956800893/'
[junit4] 2> 701614 T748 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385956800893/solr.xml
[junit4] 2> 701748 T748 oasc.CoreContainer.<init> New CoreContainer 1671859949
[junit4] 2> 701749 T748 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385956800893/]
[junit4] 2> 701751 T748 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 701751 T748 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 701752 T748 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 701752 T748 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 701752 T748 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 701753 T748 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 701753 T748 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 701754 T748 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 701754 T748 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 701775 T748 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 701776 T748 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 701776 T748 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 701777 T748 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:13165/solr
[junit4] 2> 701777 T748 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 701778 T748 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 701781 T788 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f342fe8 name:ZooKeeperConnection Watcher:127.0.0.1:13165 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 701782 T748 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 701800 T748 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 701809 T790 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a6a0d4e name:ZooKeeperConnection Watcher:127.0.0.1:13165/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 701809 T748 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 701838 T748 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 702842 T748 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46819_
[junit4] 2> 702846 T748 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46819_
[junit4] 2> 702913 T777 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 702913 T790 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 702913 T770 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 702936 T791 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 702937 T791 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 702973 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 702974 T791 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 702974 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 702974 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 702975 T771 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 702976 T771 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:46819",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:46819_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 702977 T771 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 702977 T771 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 703132 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 703146 T790 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 703146 T770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 703146 T777 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 703975 T791 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 703975 T791 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385956800893/collection1
[junit4] 2> 703975 T791 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 703977 T791 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 703977 T791 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 703978 T791 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385956800893/collection1/'
[junit4] 2> 703980 T791 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385956800893/collection1/lib/README' to classloader
[junit4] 2> 703980 T791 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385956800893/collection1/lib/classes/' to classloader
[junit4] 2> 704048 T791 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 704142 T791 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 704245 T791 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 704257 T791 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 704993 T791 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 704998 T791 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 705000 T791 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 705006 T791 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 705041 T791 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 705041 T791 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385956800893/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/jetty1/
[junit4] 2> 705041 T791 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2a2f0d89
[junit4] 2> 705043 T791 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/jetty1
[junit4] 2> 705044 T791 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/jetty1/index/
[junit4] 2> 705045 T791 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 705046 T791 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/jetty1/index
[junit4] 2> 705047 T791 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=29, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=65.7900390625, floorSegmentMB=0.6103515625, forceMergeDeletesPctAllowed=4.994081044040208, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6507784844660305
[junit4] 2> 705054 T791 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 705055 T791 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 705061 T791 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 705062 T791 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 705062 T791 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 705062 T791 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 705063 T791 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 705063 T791 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 705063 T791 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 705064 T791 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 705064 T791 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 705065 T791 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 705066 T791 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 705066 T791 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 705066 T791 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 705067 T791 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 705067 T791 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 705068 T791 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 705088 T791 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 705092 T791 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 705093 T791 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 705094 T791 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=47, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 705096 T791 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 705096 T791 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 705097 T791 oass.SolrIndexSearcher.<init> Opening Searcher@702b5459 main
[junit4] 2> 705102 T792 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@702b5459 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 705105 T791 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 705105 T791 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:46819 collection:collection1 shard:shard1
[junit4] 2> 705107 T791 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 705132 T791 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 705136 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 705136 T791 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 705136 T791 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C325 name=collection1 org.apache.solr.core.SolrCore@d4f8900 url=http://127.0.0.1:46819/collection1 node=127.0.0.1:46819_ C325_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:46819, core=collection1, node_name=127.0.0.1:46819_}
[junit4] 2> 705137 T791 C325 P46819 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:46819/collection1/
[junit4] 2> 705137 T791 C325 P46819 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 705137 T791 C325 P46819 oasc.SyncStrategy.syncToMe http://127.0.0.1:46819/collection1/ has no replicas
[junit4] 2> 705137 T771 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 705137 T791 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:46819/collection1/ shard1
[junit4] 2> 705138 T791 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 705148 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 705155 T777 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 705155 T770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 705155 T790 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 705175 T771 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 705180 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 705283 T770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 705283 T777 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 705283 T790 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 705328 T791 oasc.ZkController.register We are http://127.0.0.1:46819/collection1/ and leader is http://127.0.0.1:46819/collection1/
[junit4] 2> 705328 T791 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46819
[junit4] 2> 705328 T791 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 705328 T791 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 705329 T791 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 705331 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 705331 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 705331 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 705331 T791 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 705333 T748 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4] 2> 705333 T748 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 705333 T771 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 705334 T771 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:46819",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:46819_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 705348 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 705451 T790 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 705451 T770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 705451 T777 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 705697 T748 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 705705 T748 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:56134
[junit4] 2> 705705 T748 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 705706 T748 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 705706 T748 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385956805087
[junit4] 2> 705707 T748 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385956805087/'
[junit4] 2> 705752 T748 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385956805087/solr.xml
[junit4] 2> 705847 T748 oasc.CoreContainer.<init> New CoreContainer 547503238
[junit4] 2> 705848 T748 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385956805087/]
[junit4] 2> 705850 T748 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 705850 T748 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 705851 T748 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 705851 T748 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 705852 T748 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 705852 T748 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 705853 T748 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 705853 T748 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 705853 T748 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 705873 T748 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 705873 T748 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 705874 T748 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 705875 T748 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:13165/solr
[junit4] 2> 705875 T748 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 705876 T748 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 705883 T804 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4aaf6317 name:ZooKeeperConnection Watcher:127.0.0.1:13165 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 705884 T748 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 705888 T748 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 705902 T806 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@704c5ae3 name:ZooKeeperConnection Watcher:127.0.0.1:13165/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 705903 T748 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 705916 T748 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 706920 T748 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56134_
[junit4] 2> 706923 T748 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56134_
[junit4] 2> 706927 T770 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 706927 T806 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 706927 T790 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 706927 T777 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 706945 T807 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 706945 T807 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 706947 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 706947 T807 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 706947 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 706947 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 706949 T771 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 706950 T771 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:56134",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56134_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 706950 T771 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 706951 T771 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 706954 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 706963 T790 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 706963 T770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 706963 T777 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 706963 T806 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 707948 T807 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 707948 T807 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385956805087/collection1
[junit4] 2> 707948 T807 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 707950 T807 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 707950 T807 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 707951 T807 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385956805087/collection1/'
[junit4] 2> 707953 T807 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385956805087/collection1/lib/README' to classloader
[junit4] 2> 707953 T807 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385956805087/collection1/lib/classes/' to classloader
[junit4] 2> 708078 T807 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 708163 T807 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 708266 T807 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 708279 T807 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 709020 T807 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 709024 T807 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 709027 T807 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 709033 T807 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 709066 T807 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 709067 T807 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385956805087/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/jetty2/
[junit4] 2> 709067 T807 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2a2f0d89
[junit4] 2> 709069 T807 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/jetty2
[junit4] 2> 709070 T807 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/jetty2/index/
[junit4] 2> 709071 T807 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 709072 T807 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/jetty2/index
[junit4] 2> 709073 T807 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=29, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=65.7900390625, floorSegmentMB=0.6103515625, forceMergeDeletesPctAllowed=4.994081044040208, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6507784844660305
[junit4] 2> 709078 T807 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 709078 T807 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 709084 T807 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 709085 T807 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 709085 T807 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 709085 T807 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 709086 T807 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 709086 T807 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 709087 T807 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 709087 T807 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 709087 T807 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 709088 T807 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 709089 T807 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 709089 T807 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 709090 T807 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 709090 T807 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 709091 T807 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 709092 T807 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 709111 T807 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 709116 T807 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 709116 T807 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 709117 T807 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=47, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 709125 T807 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 709126 T807 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 709126 T807 oass.SolrIndexSearcher.<init> Opening Searcher@49a3cbde main
[junit4] 2> 709131 T808 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@49a3cbde main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 709135 T807 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 709135 T807 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56134 collection:collection1 shard:shard2
[junit4] 2> 709136 T807 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 709161 T807 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 709172 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 709172 T807 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 709173 T807 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C326 name=collection1 org.apache.solr.core.SolrCore@37faacf url=http://127.0.0.1:56134/collection1 node=127.0.0.1:56134_ C326_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:56134, core=collection1, node_name=127.0.0.1:56134_}
[junit4] 2> 709173 T807 C326 P56134 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56134/collection1/
[junit4] 2> 709173 T807 C326 P56134 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 709174 T807 C326 P56134 oasc.SyncStrategy.syncToMe http://127.0.0.1:56134/collection1/ has no replicas
[junit4] 2> 709174 T771 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 709174 T807 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56134/collection1/ shard2
[junit4] 2> 709174 T807 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 709184 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 709185 T770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 709186 T790 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 709185 T777 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 709185 T806 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 709199 T771 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 709203 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 709307 T770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 709307 T806 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 709307 T790 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 709307 T777 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 709351 T807 oasc.ZkController.register We are http://127.0.0.1:56134/collection1/ and leader is http://127.0.0.1:56134/collection1/
[junit4] 2> 709351 T807 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56134
[junit4] 2> 709351 T807 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 709351 T807 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 709352 T807 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 709354 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 709354 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 709354 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 709354 T807 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 709356 T748 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4] 2> 709357 T748 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 709356 T771 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 709358 T771 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:56134",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56134_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 709377 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 709480 T790 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 709480 T770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 709480 T777 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 709480 T806 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 709781 T748 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 709785 T748 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:65508
[junit4] 2> 709785 T748 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 709786 T748 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 709786 T748 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385956809110
[junit4] 2> 709787 T748 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385956809110/'
[junit4] 2> 709838 T748 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385956809110/solr.xml
[junit4] 2> 709976 T748 oasc.CoreContainer.<init> New CoreContainer 1095095705
[junit4] 2> 709976 T748 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385956809110/]
[junit4] 2> 709978 T748 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 709979 T748 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 709979 T748 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 709979 T748 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 709980 T748 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 709980 T748 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 709981 T748 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 709981 T748 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 709982 T748 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 710002 T748 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 710002 T748 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 710003 T748 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 710003 T748 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:13165/solr
[junit4] 2> 710004 T748 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 710005 T748 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 710024 T820 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a364a7b name:ZooKeeperConnection Watcher:127.0.0.1:13165 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 710025 T748 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 710046 T748 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 710061 T822 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53fbaad3 name:ZooKeeperConnection Watcher:127.0.0.1:13165/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 710061 T748 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 710083 T748 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 711087 T748 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65508_
[junit4] 2> 711090 T748 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65508_
[junit4] 2> 711094 T777 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 711094 T770 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 711094 T806 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 711094 T822 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 711094 T790 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 711113 T823 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 711114 T823 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 711115 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 711115 T823 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 711116 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 711116 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 711118 T771 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 711119 T771 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:65508",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:65508_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 711119 T771 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 711119 T771 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 711137 T770 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 711138 T777 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 711139 T806 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 711139 T790 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 711139 T822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 711138 T770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 712117 T823 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 712117 T823 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385956809110/collection1
[junit4] 2> 712117 T823 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 712118 T823 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 712119 T823 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 712120 T823 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385956809110/collection1/'
[junit4] 2> 712121 T823 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385956809110/collection1/lib/README' to classloader
[junit4] 2> 712122 T823 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385956809110/collection1/lib/classes/' to classloader
[junit4] 2> 712202 T823 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 712274 T823 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 712376 T823 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 712388 T823 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 713129 T823 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 713133 T823 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 713136 T823 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 713160 T823 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 713194 T823 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 713194 T823 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385956809110/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/jetty3/
[junit4] 2> 713195 T823 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2a2f0d89
[junit4] 2> 713199 T823 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/jetty3
[junit4] 2> 713200 T823 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/jetty3/index/
[junit4] 2> 713201 T823 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/jetty3/index' doesn't exist. Creating new index...
[junit4] 2> 713202 T823 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/jetty3/index
[junit4] 2> 713204 T823 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=29, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=65.7900390625, floorSegmentMB=0.6103515625, forceMergeDeletesPctAllowed=4.994081044040208, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6507784844660305
[junit4] 2> 713212 T823 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385956797375/jetty3/index,segFN=segments_1,generation=1}
[junit4] 2> 713212 T823 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 713219 T823 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 713234 T823 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 713234 T823 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 713235 T823 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 713235 T823 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 713235 T823 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 713236 T823 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 713236 T823 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 713236 T823 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 713237 T823 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 713238 T823 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 713238 T823 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 713239 T823 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 713239 T823 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 713240 T823 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 713241 T823 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 713263 T823 oashl.XMLLoader.init
[...truncated too long message...]
hards":{"shard1":{
[junit4] 1> "range":"80000000-7fffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{"core_node1":{
[junit4] 1> "state":"active",
[junit4] 1> "base_url":"http://127.0.0.1:62288",
[junit4] 1> "core":"collection1",
[junit4] 1> "node_name":"127.0.0.1:62288_",
[junit4] 1> "leader":"true"}}}}},
[junit4] 1> "collection1":{
[junit4] 1> "maxShardsPerNode":"1",
[junit4] 1> "autoCreated":"true",
[junit4] 1> "replicationFactor":"1",
[junit4] 1> "router":{"name":"compositeId"},
[junit4] 1> "shards":{
[junit4] 1> "shard1":{
[junit4] 1> "range":"80000000-ffffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node1":{
[junit4] 1> "state":"down",
[junit4] 1> "base_url":"http://127.0.0.1:46819",
[junit4] 1> "core":"collection1",
[junit4] 1> "node_name":"127.0.0.1:46819_"},
[junit4] 1> "core_node3":{
[junit4] 1> "state":"active",
[junit4] 1> "base_url":"http://127.0.0.1:65508",
[junit4] 1> "core":"collection1",
[junit4] 1> "node_name":"127.0.0.1:65508_"},
[junit4] 1> "core_node5":{
[junit4] 1> "state":"active",
[junit4] 1> "base_url":"http://127.0.0.1:34156",
[junit4] 1> "core":"collection1",
[junit4] 1> "node_name":"127.0.0.1:34156_",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node7":{
[junit4] 1> "state":"active",
[junit4] 1> "base_url":"http://127.0.0.1:57103",
[junit4] 1> "core":"collection1",
[junit4] 1> "node_name":"127.0.0.1:57103_"}}},
[junit4] 1> "shard2":{
[junit4] 1> "range":"0-7fffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node2":{
[junit4] 1> "state":"down",
[junit4] 1> "base_url":"http://127.0.0.1:56134",
[junit4] 1> "core":"collection1",
[junit4] 1> "node_name":"127.0.0.1:56134_"},
[junit4] 1> "core_node4":{
[junit4] 1> "state":"active",
[junit4] 1> "base_url":"http://127.0.0.1:53793",
[junit4] 1> "core":"collection1",
[junit4] 1> "node_name":"127.0.0.1:53793_"},
[junit4] 1> "core_node6":{
[junit4] 1> "state":"active",
[junit4] 1> "base_url":"http://127.0.0.1:53222",
[junit4] 1> "core":"collection1",
[junit4] 1> "node_name":"127.0.0.1:53222_",
[junit4] 1> "leader":"true"}}}}}}
[junit4] 1> /solr/live_nodes (6)
[junit4] 1> /solr/live_nodes/127.0.0.1:57103_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:65508_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:62288_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:34156_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:53222_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:53793_ (0)
[junit4] 1> /solr/configs (1)
[junit4] 1> /solr/configs/conf1 (11)
[junit4] 1> /solr/configs/conf1/solrconfig.snippet.randomindexconfig.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/open-exchange-rates.json (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "disclaimer": "This data is not real, it was synthetically created to match currency.xml. It is modeled after the data format available from openexchangerates.org. See https://openexchangerates.org/documentation for details",
[junit4] 1> "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4] 1> "timestamp": 1332070464,
[junit4] 1>
[junit4] 1>
[junit4] 1> "IMPORTANT NOTE": "In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4] 1>
[junit4] 1>
[junit4] 1> "base": "USD",
[junit4] 1> "rates": {
[junit4] 1> "USD": 1,
[junit4] 1> "JPY": 81.29,
[junit4] 1> "EUR": 2.5,
[junit4] 1> "GBP": 0.5,
[junit4] 1> "MXN": 2.0
[junit4] 1> }
[junit4] 1> }
[junit4] 1>
[junit4] 1> /solr/configs/conf1/enumsConfig.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/currency.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/schema.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/stopwords.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/old_synonyms.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/solrconfig.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/protwords.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/synonyms.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /zookeeper (1)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1>
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeyNothingIsSafeTest -Dtests.method=testDistribSearch -Dtests.seed=AECDF85261C18C80 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=in_ID -Dtests.timezone=America/Bahia -Dtests.file.encoding=UTF-8
[junit4] FAILURE 207s J1 | ChaosMonkeyNothingIsSafeTest.testDistribSearch <<<
[junit4] > Throwable #1: java.lang.AssertionError: There were expected update fails expected:<0> but was:<1>
[junit4] > at __randomizedtesting.SeedInfo.seed([AECDF85261C18C80:2F2B764A169EECBC]:0)
[junit4] > at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.doTest(ChaosMonkeyNothingIsSafeTest.java:202)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:843)
[junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4] 2> 904210 T748 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 206608 T747 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Lucene41, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=in_ID, timezone=America/Bahia
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=1,free=287871472,total=414187520
[junit4] 2> NOTE: All tests run in this JVM: [TestCodecSupport, SpellCheckComponentTest, TestAddFieldRealTimeGet, RAMDirectoryFactoryTest, ExpressionTest, TestCollapseQParserPlugin, TestStressRecovery, CurrencyFieldXmlFileTest, ZkNodePropsTest, TimeZoneUtilsTest, TestRandomMergePolicy, SignatureUpdateProcessorFactoryTest, OutputWriterTest, TestIndexingPerformance, AbstractAnalyticsStatsTest, TestDefaultSimilarityFactory, TestStressLucene, IndexBasedSpellCheckerTest, DisMaxRequestHandlerTest, TestComponentsName, TestBinaryResponseWriter, SuggesterTSTTest, SuggesterWFSTTest, SortByFunctionTest, FieldFacetExtrasTest, TestFastLRUCache, TestHashPartitioner, TestSolrDeletionPolicy2, MigrateRouteKeyTest, ConvertedLegacyTest, TestStressReorder, TestSerializedLuceneMatchVersion, TestManagedSchemaFieldResource, BasicZkTest, TestFieldTypeResource, TestMultiCoreConfBootstrap, SpellCheckCollatorTest, SimplePostToolTest, TestFieldResource, TestDynamicFieldResource, TestDistributedSearch, ChaosMonkeyNothingIsSafeTest]
[junit4] Completed on J1 in 206.90s, 1 test, 1 failure <<< FAILURES!
[...truncated 727 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:420: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:400: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/common-build.xml:491: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1275: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:908: There were test failures: 357 suites, 1570 tests, 1 failure, 34 ignored (6 assumptions)
Total time: 74 minutes 23 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4513 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4513/
1 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.testDistribSearch
Error Message:
There were expected update fails expected:<0> but was:<1>
Stack Trace:
java.lang.AssertionError: There were expected update fails expected:<0> but was:<1>
at __randomizedtesting.SeedInfo.seed([1D9ECD3082F9E748:9C784328F5A68774]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.doTest(ChaosMonkeyNothingIsSafeTest.java:192)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:843)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
Build Log:
[...truncated 10943 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
[junit4] 2> 1930263 T5161 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /p_/
[junit4] 2> 1930277 T5161 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./solrtest-ChaosMonkeyNothingIsSafeTest-1385880746531
[junit4] 2> 1930279 T5161 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1930280 T5162 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1930381 T5161 oasc.ZkTestServer.run start zk server on port:31706
[junit4] 2> 1930382 T5161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1930388 T5168 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@26105371 name:ZooKeeperConnection Watcher:127.0.0.1:31706 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1930389 T5161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1930389 T5161 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1930394 T5161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1930410 T5170 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ac83687 name:ZooKeeperConnection Watcher:127.0.0.1:31706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1930411 T5161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1930412 T5161 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1930416 T5161 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1930419 T5161 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1930428 T5161 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1930431 T5161 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1930432 T5161 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1930443 T5161 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1930445 T5161 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1930549 T5161 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1930550 T5161 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1930553 T5161 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1930554 T5161 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1930565 T5161 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1930566 T5161 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1930569 T5161 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1930570 T5161 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1930573 T5161 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1930573 T5161 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1930576 T5161 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1930577 T5161 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1930580 T5161 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1930581 T5161 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1930584 T5161 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1930585 T5161 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1930588 T5161 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1930589 T5161 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1930894 T5161 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1930898 T5161 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:38914
[junit4] 2> 1930899 T5161 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1930899 T5161 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1930900 T5161 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385880746852
[junit4] 2> 1930900 T5161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385880746852/'
[junit4] 2> 1930944 T5161 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385880746852/solr.xml
[junit4] 2> 1931062 T5161 oasc.CoreContainer.<init> New CoreContainer 1187502232
[junit4] 2> 1931063 T5161 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385880746852/]
[junit4] 2> 1931065 T5161 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1931066 T5161 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1931067 T5161 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1931067 T5161 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1931068 T5161 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1931068 T5161 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1931069 T5161 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1931069 T5161 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1931070 T5161 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1931089 T5161 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1931090 T5161 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1931091 T5161 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1931091 T5161 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:31706/solr
[junit4] 2> 1931092 T5161 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1931093 T5161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1931096 T5181 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@481e4e3b name:ZooKeeperConnection Watcher:127.0.0.1:31706 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1931097 T5161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1931106 T5161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1931109 T5183 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c8e19f3 name:ZooKeeperConnection Watcher:127.0.0.1:31706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1931109 T5161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1931111 T5161 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1931122 T5161 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1931126 T5161 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1931129 T5161 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38914_p_
[junit4] 2> 1931136 T5161 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38914_p_
[junit4] 2> 1931139 T5161 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1931157 T5161 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1931160 T5161 oasc.Overseer.start Overseer (id=90825080605179907-127.0.0.1:38914_p_-n_0000000000) starting
[junit4] 2> 1931172 T5161 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1931183 T5185 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1931184 T5161 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1931188 T5161 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1931190 T5161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1931193 T5184 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1931199 T5186 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1931200 T5186 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1931202 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1931202 T5186 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1931203 T5184 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1931204 T5184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:38914/p_",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38914_p_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1931204 T5184 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 1931205 T5184 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1931207 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1931217 T5183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1932203 T5186 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1932203 T5186 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385880746852/collection1
[junit4] 2> 1932204 T5186 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1932205 T5186 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1932205 T5186 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1932206 T5186 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385880746852/collection1/'
[junit4] 2> 1932208 T5186 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385880746852/collection1/lib/README' to classloader
[junit4] 2> 1932208 T5186 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385880746852/collection1/lib/classes/' to classloader
[junit4] 2> 1932281 T5186 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1932350 T5186 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1932452 T5186 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1932469 T5186 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1932669 T3 oasu.ConcurrentLRUCache.finalize ERROR ConcurrentLRUCache was not destroyed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
[junit4] 2> 1933211 T5186 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1933225 T5186 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1933230 T5186 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1933245 T5186 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1933251 T5186 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1933257 T5186 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1933258 T5186 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1933258 T5186 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1933259 T5186 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1933260 T5186 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1933260 T5186 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1933261 T5186 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1933261 T5186 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385880746852/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385880746530/control/data/
[junit4] 2> 1933261 T5186 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2bcf1a2b
[junit4] 2> 1933263 T5186 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385880746530/control/data
[junit4] 2> 1933265 T5186 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385880746530/control/data/index/
[junit4] 2> 1933266 T5186 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385880746530/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 1933267 T5186 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385880746530/control/data/index
[junit4] 2> 1933268 T5186 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=525710148, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1933273 T5186 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385880746530/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1933274 T5186 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1933279 T5186 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1933279 T5186 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1933280 T5186 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1933280 T5186 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1933280 T5186 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1933281 T5186 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1933281 T5186 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1933282 T5186 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1933282 T5186 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1933283 T5186 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1933284 T5186 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1933284 T5186 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1933284 T5186 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1933285 T5186 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1933285 T5186 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1933286 T5186 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1933303 T5186 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1933308 T5186 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1933308 T5186 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1933309 T5186 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=37, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6833502804997411]
[junit4] 2> 1933311 T5186 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385880746530/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1933312 T5186 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1933312 T5186 oass.SolrIndexSearcher.<init> Opening Searcher@7da71770 main
[junit4] 2> 1933317 T5187 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7da71770 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1933320 T5186 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1933320 T5186 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:38914/p_ collection:control_collection shard:shard1
[junit4] 2> 1933321 T5186 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1933346 T5186 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1933354 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1933355 T5186 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1933355 T5186 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1502 name=collection1 org.apache.solr.core.SolrCore@112d1010 url=http://127.0.0.1:38914/p_/collection1 node=127.0.0.1:38914_p_ C1502_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:38914/p_, core=collection1, node_name=127.0.0.1:38914_p_}
[junit4] 2> 1933355 T5186 C1502 P38914 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:38914/p_/collection1/
[junit4] 2> 1933356 T5184 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1933360 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1933361 T5183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1934857 T5186 C1502 P38914 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1934857 T5186 C1502 P38914 oasc.SyncStrategy.syncToMe http://127.0.0.1:38914/p_/collection1/ has no replicas
[junit4] 2> 1934858 T5186 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:38914/p_/collection1/ shard1
[junit4] 2> 1934858 T5186 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1934887 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1934888 T5184 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1934897 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1934899 T5183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1934938 T5186 oasc.ZkController.register We are http://127.0.0.1:38914/p_/collection1/ and leader is http://127.0.0.1:38914/p_/collection1/
[junit4] 2> 1934938 T5186 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38914/p_
[junit4] 2> 1934939 T5186 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1934939 T5186 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1934939 T5186 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1934944 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1934945 T5186 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1934946 T5184 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1934946 T5161 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4] 2> 1934947 T5161 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1934946 T5184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:38914/p_",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38914_p_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1934950 T5161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1934956 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1934957 T5190 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f8d9848 name:ZooKeeperConnection Watcher:127.0.0.1:31706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1934958 T5161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1934959 T5161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1934961 T5161 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1935060 T5183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1935060 T5190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1935299 T5161 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1935302 T5161 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:41654
[junit4] 2> 1935303 T5161 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1935303 T5161 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1935304 T5161 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385880751215
[junit4] 2> 1935304 T5161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385880751215/'
[junit4] 2> 1935347 T5161 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385880751215/solr.xml
[junit4] 2> 1935453 T5161 oasc.CoreContainer.<init> New CoreContainer 450044803
[junit4] 2> 1935454 T5161 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385880751215/]
[junit4] 2> 1935456 T5161 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1935457 T5161 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1935457 T5161 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1935458 T5161 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1935458 T5161 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1935459 T5161 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1935459 T5161 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1935460 T5161 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1935460 T5161 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1935480 T5161 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1935481 T5161 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1935481 T5161 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1935482 T5161 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:31706/solr
[junit4] 2> 1935482 T5161 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1935484 T5161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1935487 T5201 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33f843ac name:ZooKeeperConnection Watcher:127.0.0.1:31706 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1935487 T5161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1935498 T5161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1935501 T5203 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3ed7fc57 name:ZooKeeperConnection Watcher:127.0.0.1:31706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1935501 T5161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1935510 T5161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1936514 T5161 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41654_p_
[junit4] 2> 1936517 T5161 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41654_p_
[junit4] 2> 1936521 T5190 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1936521 T5203 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1936521 T5183 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1936540 T5204 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1936541 T5204 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1936543 T5204 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1936543 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1936543 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1936544 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1936545 T5184 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1936546 T5184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:41654/p_",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:41654_p_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1936547 T5184 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 1936547 T5184 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1936553 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1936659 T5190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1936659 T5203 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1936659 T5183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1937544 T5204 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1937544 T5204 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385880751215/collection1
[junit4] 2> 1937545 T5204 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1937545 T5204 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1937546 T5204 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1937547 T5204 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385880751215/collection1/'
[junit4] 2> 1937549 T5204 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385880751215/collection1/lib/README' to classloader
[junit4] 2> 1937549 T5204 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385880751215/collection1/lib/classes/' to classloader
[junit4] 2> 1937620 T5204 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1937691 T5204 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1937792 T5204 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1937809 T5204 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1938536 T5204 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1938552 T5204 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1938557 T5204 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1938574 T5204 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1938580 T5204 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1938586 T5204 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1938588 T5204 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1938588 T5204 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1938588 T5204 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1938596 T5204 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1938597 T5204 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1938598 T5204 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1938598 T5204 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385880751215/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385880746530/jetty1/
[junit4] 2> 1938599 T5204 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2bcf1a2b
[junit4] 2> 1938602 T5204 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385880746530/jetty1
[junit4] 2> 1938603 T5204 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385880746530/jetty1/index/
[junit4] 2> 1938604 T5204 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385880746530/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 1938605 T5204 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385880746530/jetty1/index
[junit4] 2> 1938607 T5204 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=525710148, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1938764 T5204 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385880746530/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 1938764 T5204 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1938771 T5204 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1938772 T5204 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1938772 T5204 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1938773 T5204 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1938773 T5204 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1938773 T5204 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1938774 T5204 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1938775 T5204 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1938775 T5204 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1938776 T5204 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1938777 T5204 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1938777 T5204 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1938778 T5204 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1938779 T5204 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1938780 T5204 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1938781 T5204 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1938799 T5204 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1938804 T5204 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1938804 T5204 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1938806 T5204 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=37, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6833502804997411]
[junit4] 2> 1938808 T5204 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385880746530/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 1938808 T5204 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1938809 T5204 oass.SolrIndexSearcher.<init> Opening Searcher@1d1ca709 main
[junit4] 2> 1938817 T5205 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d1ca709 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1938821 T5204 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1938822 T5204 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:41654/p_ collection:collection1 shard:shard1
[junit4] 2> 1938823 T5204 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1938882 T5204 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1938921 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1938922 T5204 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1938922 T5204 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 1938922 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> ASYNC NEW_CORE C1503 name=collection1 org.apache.solr.core.SolrCore@47db790e url=http://127.0.0.1:41654/p_/collection1 node=127.0.0.1:41654_p_ C1503_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:41654/p_, core=collection1, node_name=127.0.0.1:41654_p_}
[junit4] 2> 1938923 T5204 C1503 P41654 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:41654/p_/collection1/
[junit4] 2> 1938923 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1938924 T5184 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1938950 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1938952 T5190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1938952 T5203 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1938952 T5183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1940425 T5204 C1503 P41654 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1940425 T5204 C1503 P41654 oasc.SyncStrategy.syncToMe http://127.0.0.1:41654/p_/collection1/ has no replicas
[junit4] 2> 1940426 T5204 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:41654/p_/collection1/ shard1
[junit4] 2> 1940426 T5204 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1940448 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1940450 T5184 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1940459 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1940461 T5190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1940461 T5203 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1940461 T5183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1940499 T5204 oasc.ZkController.register We are http://127.0.0.1:41654/p_/collection1/ and leader is http://127.0.0.1:41654/p_/collection1/
[junit4] 2> 1940499 T5204 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:41654/p_
[junit4] 2> 1940500 T5204 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1940500 T5204 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1940500 T5204 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1940502 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1940503 T5204 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1940504 T5184 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1940504 T5161 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4] 2> 1940505 T5161 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1940505 T5184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:41654/p_",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:41654_p_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1940508 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1940612 T5190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1940612 T5203 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1940612 T5183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1940807 T5161 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1940810 T5161 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:19168
[junit4] 2> 1940811 T5161 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1940812 T5161 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1940812 T5161 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385880756759
[junit4] 2> 1940813 T5161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385880756759/'
[junit4] 2> 1940865 T5161 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385880756759/solr.xml
[junit4] 2> 1940968 T5161 oasc.CoreContainer.<init> New CoreContainer 627909751
[junit4] 2> 1940970 T5161 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385880756759/]
[junit4] 2> 1940972 T5161 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1940972 T5161 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1940973 T5161 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1940973 T5161 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1940974 T5161 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1940974 T5161 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1940975 T5161 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1940975 T5161 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1940976 T5161 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1940996 T5161 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1940997 T5161 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1940997 T5161 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1940998 T5161 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:31706/solr
[junit4] 2> 1940999 T5161 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1941000 T5161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1941003 T5217 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@31351a3d name:ZooKeeperConnection Watcher:127.0.0.1:31706 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1941003 T5161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1941014 T5161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1941016 T5219 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4894e7ff name:ZooKeeperConnection Watcher:127.0.0.1:31706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1941016 T5161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1941028 T5161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1942031 T5161 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:19168_p_
[junit4] 2> 1942043 T5161 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:19168_p_
[junit4] 2> 1942047 T5203 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1942048 T5183 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1942048 T5219 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1942048 T5190 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1942068 T5220 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1942069 T5220 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1942070 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1942070 T5220 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1942071 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1942071 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1942073 T5184 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1942074 T5184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:19168/p_",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:19168_p_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1942074 T5184 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 1942074 T5184 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 1942078 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1942180 T5190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1942180 T5203 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1942181 T5219 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1942180 T5183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1943072 T5220 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1943072 T5220 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385880756759/collection1
[junit4] 2> 1943073 T5220 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1943074 T5220 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1943074 T5220 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1943075 T5220 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385880756759/collection1/'
[junit4] 2> 1943077 T5220 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385880756759/collection1/lib/README' to classloader
[junit4] 2> 1943078 T5220 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385880756759/collection1/lib/classes/' to classloader
[junit4] 2> 1943150 T5220 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1943226 T5220 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1943328 T5220 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1943344 T5220 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1944080 T5220 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1944094 T5220 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1944099 T5220 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1944115 T5220 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1944122 T5220 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1944129 T5220 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1944132 T5220 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1944132 T5220 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1944133 T5220 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1944134 T5220 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1944134 T5220 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1944135 T5220 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1944135 T5220 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385880756759/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385880746530/jetty2/
[junit4] 2> 1944135 T5220 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2bcf1a2b
[junit4] 2> 1944137 T5220 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385880746530/jetty2
[junit4] 2> 1944138 T5220 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385880746530/jetty2/index/
[junit4] 2> 1944139 T5220 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385880746530/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 1944140 T5220 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385880746530/jetty2/index
[junit4] 2> 1944141 T5220 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=525710148, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1944147 T5220 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385880746530/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 1944148 T5220 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1944154 T5220 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1944155 T5220 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1944155 T5220 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1944156 T5220 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1944156 T5220 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1944157 T5220 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1944157 T5220 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1944158 T5220 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1944158 T5220 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1944159 T5220 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1944160 T5220 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1944161 T5220 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1944161 T5220 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1944162 T5220 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1944163 T5220 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1944164 T5220 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1944182 T5220 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1944187 T5220 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1944187 T5220 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1944189 T5220 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=37, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6833502804997411]
[junit4] 2> 1944191 T5220 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385880746530/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 1944191 T5220 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1944192 T5220 oass.SolrIndexSearcher.<init> Opening Searcher@3f5aa5c2 main
[junit4] 2> 1944199 T5221 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3f5aa5c2 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1944204 T5220 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1944205 T5220 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:19168/p_ collection:collection1 shard:shard2
[junit4] 2> 1944206 T5220 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 1944226 T5220 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 1944229 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1944229 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1944229 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1944229 T5220 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1944230 T5220 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 1944230 T5184 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C1504 name=collection1 org.apache.solr.core.SolrCore@443ae6f7 url=http://127.0.0.1:19168/p_/collection1 node=127.0.0.1:19168_p_ C1504_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:19168/p_, core=collection1, node_name=127.0.0.1:19168_p_}
[junit4] 2> 1944230 T5220 C1504 P19168 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:19168/p_/collection1/
[junit4] 2> 1944233 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1944234 T5190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1944234 T5219 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1944234 T5183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1944234 T5203 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1945732 T5220 C1504 P19168 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1945732 T5220 C1504 P19168 oasc.SyncStrategy.syncToMe http://127.0.0.1:19168/p_/collection1/ has no replicas
[junit4] 2> 1945733 T5220 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:19168/p_/collection1/ shard2
[junit4] 2> 1945733 T5220 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 1945755 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1945757 T5184 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1945760 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1945761 T5183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1945761 T5203 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1945761 T5190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1945761 T5219 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1945807 T5220 oasc.ZkController.register We are http://127.0.0.1:19168/p_/collection1/ and leader is http://127.0.0.1:19168/p_/collection1/
[junit4] 2> 1945807 T5220 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:19168/p_
[junit4] 2> 1945808 T5220 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1945808 T5220 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1945808 T5220 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1945810 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1945810 T5220 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1945811 T5184 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1945812 T5161 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4] 2> 1945813 T5161 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1945812 T5184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:19168/p_",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:19168_p_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 1945816 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1945920 T5183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1945920 T5203 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1945920 T5190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1945920 T5219 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1946120 T5161 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1946123 T5161 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:32976
[junit4] 2> 1946124 T5161 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1946124 T5161 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1946125 T5161 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385880762067
[junit4] 2> 1946125 T5161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385880762067/'
[junit4] 2> 1946169 T5161 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385880762067/solr.xml
[junit4] 2> 1946281 T5161 oasc.CoreContainer.<init> New CoreContainer 1323748204
[junit4] 2> 1946282 T5161 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385880762067/]
[junit4] 2> 1946284 T5161 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1946284 T5161 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1946285 T5161 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1946285 T5161 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1946286 T5161 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1946286 T5161 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1946287 T5161 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1946287 T5161 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1946288 T5161 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1946305 T5161 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1946306 T5161 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1946307 T5161 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1946307 T5161 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:31706/solr
[junit4] 2> 1946308 T5161 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1946309 T5161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1946312 T5233 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5652c261 name:ZooKeeperConnection Watcher:127.0.0.1:31706 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1946312 T5161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1946325 T5161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1946327 T5235 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@405156a4 name:ZooKeeperConnection Watcher:127.0.0.1:31706/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1946327 T5161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1946336 T5161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1947340 T5161 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32976_p_
[junit4] 2> 1947343 T5161 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32976_p_
[junit4] 2> 1947347 T5219 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1947347 T5235 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1947347 T5183 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1947347 T5203 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1947347 T5190 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1947364 T5236 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1947364 T5236 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1947366 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1947366 T5236 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1947366 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1947367 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1947368 T5184 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1947369 T5184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:32976/p_",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:32976_p_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1947369 T5184 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 1947369 T5184 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1947373 T5183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1947486 T5235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1947486 T5183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1947486 T5203 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1947486 T5219 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1947486 T5190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1948368 T5236 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1948368 T5236 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385880762067/collection1
[junit4] 2> 1948369 T5236 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1948370 T5236 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1948370 T5236 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1948371 T5236 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud
[...truncated too long message...]
solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:409)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:378)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:365)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:102)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:266)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:165)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:109)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:138)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 2206526 T5306 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election/90825080605179922-core_node7-n_0000000003
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:169)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:166)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:166)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:66)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:269)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:165)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:109)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:138)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 2206526 T5306 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:252)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:249)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:249)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:93)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:138)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 2206527 T5306 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=146), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=146)), sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=sr_ME_#Latn, timezone=America/New_York
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=2,free=161843248,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [CurrencyFieldXmlFileTest, OpenExchangeRatesOrgProviderTest, StandardRequestHandlerTest, TermVectorComponentDistributedTest, TestFieldTypeCollectionResource, TestDistributedGrouping, TestSchemaNameResource, TestSolrXml, TestInfoStreamLogging, FileUtilsTest, RequiredFieldsTest, FieldAnalysisRequestHandlerTest, TestNumberUtils, TestZkChroot, AbstractAnalyticsStatsTest, TestXIncludeConfig, ShardRoutingCustomTest, PingRequestHandlerTest, DeleteInactiveReplicaTest, ChaosMonkeySafeLeaderTest, ConvertedLegacyTest, SuggesterTSTTest, DateFieldTest, TestFieldResource, NotRequiredUniqueKeyTest, TestRecoveryHdfs, TestFastWriter, TestDynamicFieldResource, RAMDirectoryFactoryTest, DeleteReplicaTest, SortByFunctionTest, SimplePostToolTest, TestDefaultSearchFieldResource, DistributedQueryComponentCustomSortTest, CurrencyFieldOpenExchangeTest, SolrCmdDistributorTest, TestRecovery, TestManagedSchemaFieldResource, SolrIndexConfigTest, TestQuerySenderListener, TestCollationField, CachingDirectoryFactoryTest, ZkSolrClientTest, TestSerializedLuceneMatchVersion, TestCSVLoader, SolrPluginUtilsTest, TestStressReorder, HardAutoCommitTest, StatsComponentTest, TestReload, TestAnalyzedSuggestions, TestFoldingMultitermQuery, TestFileDictionaryLookup, TestLazyCores, CoreContainerCoreInitFailuresTest, JSONWriterTest, LeaderElectionIntegrationTest, TestSolrCoreProperties, DisMaxRequestHandlerTest, DocumentAnalysisRequestHandlerTest, UniqFieldsUpdateProcessorFactoryTest, TestJmxIntegration, CollectionsAPIDistributedZkTest, BlockDirectoryTest, NoFacetTest, OutputWriterTest, ExpressionTest, ModifyConfFileTest, RequestHandlersTest, MultiTermTest, DistanceFunctionTest, TestIndexingPerformance, TestComponentsName, HdfsUnloadDistributedZkTest, PluginInfoTest, OpenCloseCoreStressTest, PreAnalyzedFieldTest, TestWordDelimiterFilterFactory, PrimUtilsTest, TestRandomFaceting, TestDistributedSearch, TestBinaryField, TestDistributedMissingSort, TestIBSimilarityFactory, BasicDistributedZkTest, BasicDistributedZk2Test, FullSolrCloudDistribCmdsTest, TestReplicationHandler, LeaderElectionTest, TestRandomDVFaceting, ZkCLITest, TestHashPartitioner, ZkControllerTest, TestRealTimeGet, TestCoreContainer, BadIndexSchemaTest, TestSort, TestFiltering, SoftAutoCommitTest, TestExtendedDismaxParser, SolrRequestParserTest, TestStressLucene, TestTrie, NoCacheHeaderTest, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, TestAtomicUpdateErrorCases, DefaultValueUpdateProcessorTest, DocValuesMultiTest, XsltUpdateRequestHandlerTest, IndexBasedSpellCheckerTest, DirectSolrSpellCheckerTest, TestOmitPositions, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, TestArbitraryIndexDir, IndexSchemaRuntimeFieldTest, ReturnFieldsTest, TestCSVResponseWriter, BinaryUpdateRequestHandlerTest, TestPHPSerializedResponseWriter, TestBinaryResponseWriter, SOLR749Test, AlternateDirectoryTest, TestQuerySenderNoQuery, ResponseLogComponentTest, TestMergePolicyConfig, TestSolrDeletionPolicy2, SampleTest, NumericFieldsTest, MinimalSchemaTest, TestConfig, TestFuzzyAnalyzedSuggestions, TestPostingsSolrHighlighter, DirectSolrConnectionTest, TestLuceneMatchVersion, TestPhraseSuggestions, SpellPossibilityIteratorTest, TestCodecSupport, EchoParamsTest, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestDefaultSimilarityFactory, TestJmxMonitoredMap, TimeZoneUtilsTest, TestFastOutputStream, ScriptEngineTest, URLClassifyProcessorTest, TestFastLRUCache, ChaosMonkeyNothingIsSafeTest]
[junit4] Completed on J1 in 277.17s, 1 test, 1 failure <<< FAILURES!
[...truncated 124 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:420: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:400: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/common-build.xml:491: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1275: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:908: There were test failures: 357 suites, 1569 tests, 1 failure, 34 ignored (6 assumptions)
Total time: 65 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure