You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/12/12 23:44:10 UTC
[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1810 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1810/
1 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.testDistribSearch
Error Message:
There were expected update fails expected:<0> but was:<1>
Stack Trace:
java.lang.AssertionError: There were expected update fails expected:<0> but was:<1>
at __randomizedtesting.SeedInfo.seed([AA1A4808CC1D9633:2BFCC610BB42F60F]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.doTest(ChaosMonkeyNothingIsSafeTest.java:202)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:849)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
Build Log:
[...truncated 10450 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
[junit4] 2> 1551424 T2223 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /th/
[junit4] 2> 1551431 T2223 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeyNothingIsSafeTest-1386887218617
[junit4] 2> 1551432 T2223 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1551433 T2224 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1551534 T2223 oasc.ZkTestServer.run start zk server on port:25168
[junit4] 2> 1551535 T2223 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1551540 T2230 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b479082 name:ZooKeeperConnection Watcher:127.0.0.1:25168 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1551540 T2223 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1551540 T2223 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1551579 T2223 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1551581 T2232 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f3f0afb name:ZooKeeperConnection Watcher:127.0.0.1:25168/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1551581 T2223 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1551582 T2223 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1551585 T2223 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1551588 T2223 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1551590 T2223 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1551593 T2223 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1551593 T2223 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1551599 T2223 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1551600 T2223 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1551703 T2223 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1551704 T2223 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1551714 T2223 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1551715 T2223 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1551719 T2223 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1551719 T2223 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1551723 T2223 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1551724 T2223 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1551727 T2223 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1551727 T2223 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1551731 T2223 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1551731 T2223 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1551734 T2223 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1551735 T2223 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1551739 T2223 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1551740 T2223 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1551743 T2223 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1551743 T2223 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1552046 T2223 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1552051 T2223 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:48112
[junit4] 2> 1552052 T2223 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1552053 T2223 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1552053 T2223 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1386887218939
[junit4] 2> 1552053 T2223 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1386887218939/'
[junit4] 2> 1552091 T2223 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1386887218939/solr.xml
[junit4] 2> 1552194 T2223 oasc.CoreContainer.<init> New CoreContainer 1605241852
[junit4] 2> 1552194 T2223 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1386887218939/]
[junit4] 2> 1552196 T2223 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1552197 T2223 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1552197 T2223 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1552197 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1552198 T2223 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1552198 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1552199 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1552199 T2223 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1552199 T2223 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1552218 T2223 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1552219 T2223 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1552219 T2223 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1552220 T2223 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:25168/solr
[junit4] 2> 1552220 T2223 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1552221 T2223 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1552224 T2243 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6f28da22 name:ZooKeeperConnection Watcher:127.0.0.1:25168 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1552224 T2223 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1552227 T2223 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1552236 T2245 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d52f73b name:ZooKeeperConnection Watcher:127.0.0.1:25168/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1552237 T2223 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1552239 T2223 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1552250 T2223 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1552253 T2223 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1552255 T2223 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48112_th
[junit4] 2> 1552263 T2223 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48112_th
[junit4] 2> 1552266 T2223 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1552279 T2223 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1552289 T2223 oasc.Overseer.start Overseer (id=90891040759808003-127.0.0.1:48112_th-n_0000000000) starting
[junit4] 2> 1552294 T2223 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1552308 T2247 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1552309 T2223 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1552312 T2223 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1552318 T2223 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1552321 T2246 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1552327 T2248 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1552327 T2248 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1552329 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1552329 T2248 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1552331 T2246 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1552331 T2246 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:48112/th",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:48112_th",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1552332 T2246 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 1552332 T2246 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1552340 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1552341 T2245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1553331 T2248 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1553331 T2248 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1386887218939/collection1
[junit4] 2> 1553331 T2248 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1553332 T2248 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1553333 T2248 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1553334 T2248 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1386887218939/collection1/'
[junit4] 2> 1553335 T2248 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1386887218939/collection1/lib/classes/' to classloader
[junit4] 2> 1553336 T2248 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1386887218939/collection1/lib/README' to classloader
[junit4] 2> 1553420 T2248 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1553487 T2248 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1553589 T2248 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1553600 T2248 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1554270 T2248 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1554275 T2248 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1554277 T2248 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1554282 T2248 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1554307 T2248 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1554355 T2248 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1386887218939/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/control/data/
[junit4] 2> 1554355 T2248 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d7682a5
[junit4] 2> 1554357 T2248 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/control/data
[junit4] 2> 1554358 T2248 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/control/data/index/
[junit4] 2> 1554359 T2248 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 1554360 T2248 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/control/data/index
[junit4] 2> 1554361 T2248 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=95.1025390625, floorSegmentMB=1.994140625, forceMergeDeletesPctAllowed=17.218483530605774, segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5400920278401543
[junit4] 2> 1554375 T2248 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1554375 T2248 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1554379 T2248 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1554380 T2248 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1554380 T2248 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1554380 T2248 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1554381 T2248 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1554381 T2248 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1554382 T2248 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1554382 T2248 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1554382 T2248 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1554383 T2248 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1554383 T2248 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1554384 T2248 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1554384 T2248 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1554385 T2248 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1554385 T2248 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1554386 T2248 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1554402 T2248 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1554407 T2248 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1554407 T2248 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1554408 T2248 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=88.9384765625, floorSegmentMB=1.3056640625, forceMergeDeletesPctAllowed=8.325436118833832, segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1554410 T2248 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1554410 T2248 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1554411 T2248 oass.SolrIndexSearcher.<init> Opening Searcher@2c6a9215 main
[junit4] 2> 1554414 T2249 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2c6a9215 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1554416 T2248 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1554416 T2248 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48112/th collection:control_collection shard:shard1
[junit4] 2> 1554417 T2248 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1554439 T2248 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1554450 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1554450 T2248 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1554450 T2248 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C556 name=collection1 org.apache.solr.core.SolrCore@5b571ccc url=http://127.0.0.1:48112/th/collection1 node=127.0.0.1:48112_th C556_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:48112/th, core=collection1, node_name=127.0.0.1:48112_th}
[junit4] 2> 1554451 T2248 C556 P48112 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:48112/th/collection1/
[junit4] 2> 1554451 T2246 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1554451 T2248 C556 P48112 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1554452 T2248 C556 P48112 oasc.SyncStrategy.syncToMe http://127.0.0.1:48112/th/collection1/ has no replicas
[junit4] 2> 1554452 T2248 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:48112/th/collection1/ shard1
[junit4] 2> 1554452 T2248 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1554455 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1554466 T2245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1554472 T2246 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1554484 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1554586 T2245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1554625 T2248 oasc.ZkController.register We are http://127.0.0.1:48112/th/collection1/ and leader is http://127.0.0.1:48112/th/collection1/
[junit4] 2> 1554625 T2248 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48112/th
[junit4] 2> 1554625 T2248 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1554625 T2248 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1554626 T2248 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1554627 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1554627 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1554627 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1554627 T2248 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1554629 T2223 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4] 2> 1554629 T2223 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1554629 T2246 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1554631 T2246 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:48112/th",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:48112_th",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1554632 T2223 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1554634 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1554643 T2252 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7a236314 name:ZooKeeperConnection Watcher:127.0.0.1:25168/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1554643 T2223 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1554645 T2223 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1554647 T2223 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1554746 T2245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1554746 T2252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1554933 T2223 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1554935 T2223 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:23174
[junit4] 2> 1554936 T2223 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1554936 T2223 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1554937 T2223 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1386887221833
[junit4] 2> 1554937 T2223 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1386887221833/'
[junit4] 2> 1554975 T2223 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1386887221833/solr.xml
[junit4] 2> 1555085 T2223 oasc.CoreContainer.<init> New CoreContainer 303612140
[junit4] 2> 1555085 T2223 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1386887221833/]
[junit4] 2> 1555087 T2223 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1555088 T2223 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1555088 T2223 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1555088 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1555089 T2223 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1555089 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1555090 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1555090 T2223 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1555091 T2223 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1555109 T2223 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1555109 T2223 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1555110 T2223 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1555110 T2223 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:25168/solr
[junit4] 2> 1555111 T2223 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1555112 T2223 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1555115 T2263 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@94ad9c1 name:ZooKeeperConnection Watcher:127.0.0.1:25168 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1555115 T2223 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1555127 T2223 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1555128 T2265 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@20e22de5 name:ZooKeeperConnection Watcher:127.0.0.1:25168/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1555129 T2223 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1555140 T2223 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1556143 T2223 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:23174_th
[junit4] 2> 1556171 T2223 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:23174_th
[junit4] 2> 1556175 T2245 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1556175 T2265 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1556175 T2252 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1556192 T2266 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1556192 T2266 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1556194 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1556194 T2266 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1556194 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1556195 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1556196 T2246 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1556196 T2246 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:23174/th",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:23174_th",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1556197 T2246 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 1556197 T2246 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 1556200 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1556303 T2265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1556303 T2252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1556303 T2245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1557196 T2266 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1557196 T2266 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1386887221833/collection1
[junit4] 2> 1557196 T2266 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1557197 T2266 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1557198 T2266 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1557199 T2266 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1386887221833/collection1/'
[junit4] 2> 1557201 T2266 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1386887221833/collection1/lib/classes/' to classloader
[junit4] 2> 1557201 T2266 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1386887221833/collection1/lib/README' to classloader
[junit4] 2> 1557265 T2266 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1557345 T2266 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1557446 T2266 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1557457 T2266 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1558108 T2266 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1558112 T2266 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1558114 T2266 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1558119 T2266 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1558144 T2266 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1558144 T2266 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1386887221833/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/jetty1/
[junit4] 2> 1558144 T2266 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d7682a5
[junit4] 2> 1558146 T2266 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/jetty1
[junit4] 2> 1558147 T2266 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/jetty1/index/
[junit4] 2> 1558147 T2266 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 1558149 T2266 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/jetty1/index
[junit4] 2> 1558149 T2266 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=95.1025390625, floorSegmentMB=1.994140625, forceMergeDeletesPctAllowed=17.218483530605774, segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5400920278401543
[junit4] 2> 1558153 T2266 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 1558154 T2266 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1558159 T2266 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1558159 T2266 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1558160 T2266 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1558160 T2266 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1558160 T2266 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1558160 T2266 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1558161 T2266 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1558161 T2266 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1558162 T2266 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1558163 T2266 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1558163 T2266 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1558163 T2266 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1558164 T2266 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1558165 T2266 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1558165 T2266 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1558166 T2266 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1558183 T2266 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1558187 T2266 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1558187 T2266 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1558188 T2266 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=88.9384765625, floorSegmentMB=1.3056640625, forceMergeDeletesPctAllowed=8.325436118833832, segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1558190 T2266 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 1558190 T2266 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1558190 T2266 oass.SolrIndexSearcher.<init> Opening Searcher@7082d9ad main
[junit4] 2> 1558195 T2267 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7082d9ad main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1558198 T2266 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1558198 T2266 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:23174/th collection:collection1 shard:shard2
[junit4] 2> 1558199 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 1558219 T2266 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 1558227 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1558227 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1558228 T2266 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1558228 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1558228 T2266 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C557 name=collection1 org.apache.solr.core.SolrCore@315c0b9 url=http://127.0.0.1:23174/th/collection1 node=127.0.0.1:23174_th C557_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:23174/th, core=collection1, node_name=127.0.0.1:23174_th}
[junit4] 2> 1558228 T2266 C557 P23174 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:23174/th/collection1/
[junit4] 2> 1558229 T2246 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1558229 T2266 C557 P23174 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1558229 T2266 C557 P23174 oasc.SyncStrategy.syncToMe http://127.0.0.1:23174/th/collection1/ has no replicas
[junit4] 2> 1558230 T2266 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:23174/th/collection1/ shard2
[junit4] 2> 1558230 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 1558233 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1558242 T2252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1558242 T2265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1558242 T2245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1558263 T2246 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1558272 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1558375 T2252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1558375 T2265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1558375 T2245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1558415 T2266 oasc.ZkController.register We are http://127.0.0.1:23174/th/collection1/ and leader is http://127.0.0.1:23174/th/collection1/
[junit4] 2> 1558415 T2266 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:23174/th
[junit4] 2> 1558415 T2266 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1558415 T2266 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1558416 T2266 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1558417 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1558418 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1558418 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1558418 T2266 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1558419 T2246 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1558419 T2223 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4] 2> 1558420 T2223 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1558420 T2246 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:23174/th",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:23174_th",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1558429 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1558532 T2245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1558532 T2265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1558532 T2252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1558708 T2223 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1558711 T2223 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:47150
[junit4] 2> 1558711 T2223 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1558712 T2223 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1558712 T2223 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1386887225606
[junit4] 2> 1558713 T2223 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1386887225606/'
[junit4] 2> 1558750 T2223 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1386887225606/solr.xml
[junit4] 2> 1558858 T2223 oasc.CoreContainer.<init> New CoreContainer 858586785
[junit4] 2> 1558859 T2223 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1386887225606/]
[junit4] 2> 1558861 T2223 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1558861 T2223 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1558862 T2223 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1558862 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1558863 T2223 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1558863 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1558864 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1558864 T2223 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1558864 T2223 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1558883 T2223 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1558883 T2223 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1558884 T2223 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1558884 T2223 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:25168/solr
[junit4] 2> 1558885 T2223 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1558886 T2223 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1558888 T2279 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@42f32c9f name:ZooKeeperConnection Watcher:127.0.0.1:25168 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1558889 T2223 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1558893 T2223 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1558901 T2281 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76fd72ee name:ZooKeeperConnection Watcher:127.0.0.1:25168/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1558901 T2223 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1558906 T2223 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1559911 T2223 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47150_th
[junit4] 2> 1559939 T2223 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47150_th
[junit4] 2> 1559943 T2265 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1559943 T2281 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1559943 T2252 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1559943 T2245 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1559960 T2282 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1559960 T2282 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1559962 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1559962 T2282 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1559962 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1559962 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1559964 T2246 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1559965 T2246 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:47150/th",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:47150_th",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1559965 T2246 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 1559965 T2246 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1559968 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1560071 T2245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1560071 T2281 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1560071 T2265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1560071 T2252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1560963 T2282 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1560963 T2282 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1386887225606/collection1
[junit4] 2> 1560963 T2282 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1560964 T2282 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1560964 T2282 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1560966 T2282 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1386887225606/collection1/'
[junit4] 2> 1560967 T2282 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1386887225606/collection1/lib/classes/' to classloader
[junit4] 2> 1560968 T2282 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1386887225606/collection1/lib/README' to classloader
[junit4] 2> 1561046 T2282 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1561110 T2282 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1561212 T2282 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1561223 T2282 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1561871 T2282 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1561875 T2282 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1561877 T2282 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1561882 T2282 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1561921 T2282 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1561922 T2282 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1386887225606/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/jetty2/
[junit4] 2> 1561922 T2282 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d7682a5
[junit4] 2> 1561924 T2282 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/jetty2
[junit4] 2> 1561924 T2282 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/jetty2/index/
[junit4] 2> 1561925 T2282 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 1561926 T2282 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/jetty2/index
[junit4] 2> 1561927 T2282 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=95.1025390625, floorSegmentMB=1.994140625, forceMergeDeletesPctAllowed=17.218483530605774, segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5400920278401543
[junit4] 2> 1561931 T2282 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 1561931 T2282 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1561936 T2282 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1561936 T2282 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1561937 T2282 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1561937 T2282 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1561937 T2282 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1561938 T2282 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1561938 T2282 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1561938 T2282 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1561939 T2282 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1561939 T2282 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1561940 T2282 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1561940 T2282 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1561941 T2282 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1561941 T2282 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1561942 T2282 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1561943 T2282 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1561958 T2282 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1561962 T2282 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1561962 T2282 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1561963 T2282 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=88.9384765625, floorSegmentMB=1.3056640625, forceMergeDeletesPctAllowed=8.325436118833832, segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1561965 T2282 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 1561965 T2282 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1561965 T2282 oass.SolrIndexSearcher.<init> Opening Searcher@6146579d main
[junit4] 2> 1561970 T2283 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6146579d main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1561972 T2282 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1561973 T2282 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:47150/th collection:collection1 shard:shard1
[junit4] 2> 1561974 T2282 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1561993 T2282 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1561996 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1561996 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1561996 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1561996 T2282 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1561997 T2282 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C558 name=collection1 org.apache.solr.core.SolrCore@57135913 url=http://127.0.0.1:47150/th/collection1 node=127.0.0.1:47150_th C558_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:47150/th, core=collection1, node_name=127.0.0.1:47150_th}
[junit4] 2> 1561997 T2282 C558 P47150 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:47150/th/collection1/
[junit4] 2> 1561997 T2282 C558 P47150 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1561997 T2246 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1561998 T2282 C558 P47150 oasc.SyncStrategy.syncToMe http://127.0.0.1:47150/th/collection1/ has no replicas
[junit4] 2> 1561998 T2282 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:47150/th/collection1/ shard1
[junit4] 2> 1561998 T2282 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1562001 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1562002 T2245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1562002 T2265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1562002 T2252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1562002 T2281 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1562006 T2246 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1562009 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1562113 T2245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1562113 T2265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1562113 T2252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1562113 T2281 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1562158 T2282 oasc.ZkController.register We are http://127.0.0.1:47150/th/collection1/ and leader is http://127.0.0.1:47150/th/collection1/
[junit4] 2> 1562158 T2282 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47150/th
[junit4] 2> 1562158 T2282 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1562158 T2282 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1562159 T2282 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1562160 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1562160 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1562160 T2282 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1562160 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1562162 T2223 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4] 2> 1562162 T2223 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1562162 T2246 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1562163 T2246 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:47150/th",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:47150_th",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 1562166 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1562270 T2245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1562270 T2265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1562270 T2252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1562270 T2281 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1562427 T2223 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1562430 T2223 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:30823
[junit4] 2> 1562431 T2223 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1562431 T2223 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1562432 T2223 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1386887229349
[junit4] 2> 1562432 T2223 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1386887229349/'
[junit4] 2> 1562466 T2223 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1386887229349/solr.xml
[junit4] 2> 1562553 T2223 oasc.CoreContainer.<init> New CoreContainer 1418613598
[junit4] 2> 1562554 T2223 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1386887229349/]
[junit4] 2> 1562556 T2223 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1562556 T2223 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1562557 T2223 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1562557 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1562557 T2223 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1562558 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1562558 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1562559 T2223 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1562559 T2223 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1562576 T2223 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1562576 T2223 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1562577 T2223 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1562577 T2223 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:25168/solr
[junit4] 2> 1562578 T2223 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1562579 T2223 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1562620 T2295 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@47e8fbbb name:ZooKeeperConnection Watcher:127.0.0.1:25168 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1562621 T2223 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1562624 T2223 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1562626 T2297 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48b8c866 name:ZooKeeperConnection Watcher:127.0.0.1:25168/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1562626 T2223 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1562637 T2223 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1563640 T2223 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:30823_th
[junit4] 2> 1563642 T2223 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:30823_th
[junit4] 2> 1563646 T2245 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1563646 T2265 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1563646 T2297 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1563646 T2281 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1563646 T2252 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1563655 T2298 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1563656 T2298 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1563657 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1563658 T2298 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1563658 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1563658 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1563660 T2246 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1563661 T2246 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:30823/th",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:30823_th",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1563661 T2246 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 1563661 T2246 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 1563664 T2245 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1563767 T2252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1563768 T2281 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1563768 T2265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1563768 T2297 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1563767 T2245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1564659 T2298 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1564659 T2298 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1386887229349/collection1
[junit4] 2> 1564659 T2298 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1564660 T2298 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1564661 T2298 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1564662 T2298 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1386887229349/collection1/'
[junit4] 2> 1564663 T2298 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1386887229349/collection1/lib/README' to classloader
[junit4] 2> 1564664 T2298 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1386887229349/collection1/lib/classes/' to classloader
[junit4] 2> 1564728 T2298 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1564806 T2298 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1564907 T2298 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1564918 T2298 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1565566 T2298 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1565570 T2298 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1565573 T2298 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1565578 T2298 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1565602 T2298 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1565602 T2298 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1386887229349/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/jetty3/
[junit4] 2> 1565603 T2298 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d7682a5
[junit4] 2> 1565604 T2298 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/jetty3
[junit4] 2> 1565605 T2298 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/jetty3/index/
[junit4] 2> 1565606 T2298 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/jetty3/index' doesn't exist. Creating new index...
[junit4] 2> 1565607 T2298 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/jetty3/index
[junit4] 2> 1565608 T2298 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=95.1025390625, floorSegmentMB=1
[...truncated too long message...]
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/jetty7/index;done=false>>]
[junit4] 2> 1748395 T2413 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386887218616/jetty7/index
[junit4] 2> 1748395 T2413 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 1748396 T2413 oasc.SolrException.log ERROR There was a problem trying to register as the leader:org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:409)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:378)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:365)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:102)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:277)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:165)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:109)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:138)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 1748396 T2413 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election/90891040759808020-core_node7-n_0000000004
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:169)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:166)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:166)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:66)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:280)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:165)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:109)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:138)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 1748397 T2413 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1748397 T2413 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1748397 T2413 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:252)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:249)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:249)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:93)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:138)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 1748398 T2413 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1748429 T2350 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Lucene40, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=ar_QA, timezone=Asia/Colombo
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=1,free=47551984,total=98566144
[junit4] 2> NOTE: All tests run in this JVM: [TestCSVLoader, IndexSchemaRuntimeFieldTest, DOMUtilTest, HdfsChaosMonkeySafeLeaderTest, TestUpdate, TermsComponentTest, TestBadConfig, DocumentBuilderTest, ShardRoutingTest, TestSolrIndexConfig, NumericFieldsTest, HdfsLockFactoryTest, TestTrie, TestSerializedLuceneMatchVersion, IndexBasedSpellCheckerTest, LegacyHTMLStripCharFilterTest, TestCustomSort, TestSort, SimpleFacetsTest, DeleteInactiveReplicaTest, TestSolrXmlPersistence, TestFileDictionaryLookup, TestUniqueKeyFieldResource, ZkSolrClientTest, BlockCacheTest, SOLR749Test, SortByFunctionTest, SpatialFilterTest, SchemaVersionSpecificBehaviorTest, TestSearchPerf, TestCloudManagedSchema, DateMathParserTest, CurrencyFieldXmlFileTest, TestStressReorder, ShardRoutingCustomTest, TestWriterPerf, BadIndexSchemaTest, TermVectorComponentTest, TestLRUCache, TestLMDirichletSimilarityFactory, HdfsUnloadDistributedZkTest, SuggesterTSTTest, TestDefaultSimilarityFactory, CSVRequestHandlerTest, OpenExchangeRatesOrgProviderTest, StatelessScriptUpdateProcessorFactoryTest, TestHighFrequencyDictionaryFactory, RequiredFieldsTest, QueryElevationComponentTest, TestFoldingMultitermQuery, TestManagedSchemaFieldResource, TestSimpleQParserPlugin, DirectSolrSpellCheckerTest, TestOmitPositions, IndexSchemaTest, SimplePostToolTest, TestDynamicFieldCollectionResource, ExternalFileFieldSortTest, AddSchemaFieldsUpdateProcessorFactoryTest, PrimUtilsTest, RecoveryZkTest, DebugComponentTest, HdfsCollectionsAPIDistributedZkTest, InfoHandlerTest, FastVectorHighlighterTest, AddBlockUpdateTest, TestFunctionQuery, ResourceLoaderTest, BasicDistributedZkTest, SpellingQueryConverterTest, TestAnalyzedSuggestions, LeaderElectionIntegrationTest, XmlUpdateRequestHandlerTest, TestLFUCache, TestQueryUtils, PrimitiveFieldTypeTest, TestReloadAndDeleteDocs, TestFieldTypeCollectionResource, OpenCloseCoreStressTest, CoreAdminCreateDiscoverTest, HdfsSyncSliceTest, TestDistributedGrouping, SolrPluginUtilsTest, SyncSliceTest, ChaosMonkeyNothingIsSafeTest]
[junit4] Completed on J0 in 198.68s, 1 test, 1 failure <<< FAILURES!
[...truncated 528 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:459: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:439: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:491: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1307: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:940: There were test failures: 347 suites, 1516 tests, 1 failure, 34 ignored (6 assumptions)
Total time: 69 minutes 16 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1811 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1811/
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest
Error Message:
testParserCoverage was run w/o any other method explicitly testing val parser: concat
Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing val parser: concat
at __randomizedtesting.SeedInfo.seed([4C9321D745133B4F]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:65)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
FAILED: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.testDistribSearch
Error Message:
There were expected update fails expected:<0> but was:<1>
Stack Trace:
java.lang.AssertionError: There were expected update fails expected:<0> but was:<1>
at __randomizedtesting.SeedInfo.seed([4C9321D745133B4F:CD75AFCF324C5B73]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.doTest(ChaosMonkeyNothingIsSafeTest.java:202)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:849)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
Build Log:
[...truncated 10120 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
[junit4] 2> 469551 T661 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 469557 T661 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solrtest-ChaosMonkeyNothingIsSafeTest-1386928548200
[junit4] 2> 469558 T661 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 469558 T662 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 469660 T661 oasc.ZkTestServer.run start zk server on port:13292
[junit4] 2> 469661 T661 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 469665 T668 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4979a8d8 name:ZooKeeperConnection Watcher:127.0.0.1:13292 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 469665 T661 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 469666 T661 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 469684 T661 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 469687 T670 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e8220d5 name:ZooKeeperConnection Watcher:127.0.0.1:13292/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 469687 T661 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 469687 T661 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 469691 T661 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 469700 T661 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 469702 T661 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 469705 T661 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 469706 T661 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 469718 T661 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 469718 T661 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 469826 T661 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 469826 T661 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 469839 T661 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 469840 T661 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 469843 T661 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 469843 T661 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 469846 T661 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 469847 T661 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 469850 T661 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 469850 T661 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 469853 T661 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 469854 T661 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 469862 T661 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 469863 T661 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 469866 T661 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 469867 T661 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 469870 T661 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 469870 T661 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 470187 T661 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 470192 T661 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:36646
[junit4] 2> 470193 T661 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 470193 T661 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 470194 T661 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1386928548523
[junit4] 2> 470194 T661 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1386928548523/'
[junit4] 2> 470237 T661 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1386928548523/solr.xml
[junit4] 2> 470343 T661 oasc.CoreContainer.<init> New CoreContainer 1167805817
[junit4] 2> 470344 T661 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1386928548523/]
[junit4] 2> 470346 T661 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 470346 T661 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 470346 T661 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 470347 T661 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 470347 T661 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 470348 T661 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 470348 T661 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 470349 T661 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 470349 T661 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 470370 T661 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 470371 T661 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 470371 T661 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 470372 T661 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:13292/solr
[junit4] 2> 470372 T661 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 470374 T661 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 470377 T681 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d6143bb name:ZooKeeperConnection Watcher:127.0.0.1:13292 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 470377 T661 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 470380 T661 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 470389 T683 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@65d201b5 name:ZooKeeperConnection Watcher:127.0.0.1:13292/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 470389 T661 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 470391 T661 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 470402 T661 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 470405 T661 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 470407 T661 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36646_
[junit4] 2> 470415 T661 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36646_
[junit4] 2> 470417 T661 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 470435 T661 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 470437 T661 oasc.Overseer.start Overseer (id=90893749335293955-127.0.0.1:36646_-n_0000000000) starting
[junit4] 2> 470449 T661 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 470461 T685 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 470462 T661 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 470464 T661 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 470466 T661 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 470468 T684 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 470474 T686 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 470474 T686 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 470476 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 470476 T686 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 470477 T684 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 470478 T684 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:36646",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:36646_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 470478 T684 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 470478 T684 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 470486 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 470487 T683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 471477 T686 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 471477 T686 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1386928548523/collection1
[junit4] 2> 471477 T686 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 471478 T686 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 471479 T686 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 471480 T686 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1386928548523/collection1/'
[junit4] 2> 471481 T686 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1386928548523/collection1/lib/README' to classloader
[junit4] 2> 471482 T686 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1386928548523/collection1/lib/classes/' to classloader
[junit4] 2> 471557 T686 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 471629 T686 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 471732 T686 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 471744 T686 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 472377 T686 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 472381 T686 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 472384 T686 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 472390 T686 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 472416 T686 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 472472 T686 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1386928548523/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386928548199/control/data/
[junit4] 2> 472473 T686 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@61f7ff6c
[junit4] 2> 472475 T686 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386928548199/control/data
[junit4] 2> 472476 T686 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386928548199/control/data/index/
[junit4] 2> 472477 T686 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386928548199/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 472479 T686 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386928548199/control/data/index
[junit4] 2> 472479 T686 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=49.267578125, floorSegmentMB=1.7734375, forceMergeDeletesPctAllowed=11.35500409347196, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.752424645732454
[junit4] 2> 472510 T686 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386928548199/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 472511 T686 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 472516 T686 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 472516 T686 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 472517 T686 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 472517 T686 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 472517 T686 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 472518 T686 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 472518 T686 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 472519 T686 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 472519 T686 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 472520 T686 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 472520 T686 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 472520 T686 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 472521 T686 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 472521 T686 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 472522 T686 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 472523 T686 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 472541 T686 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 472546 T686 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 472546 T686 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 472547 T686 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=82.6240234375, floorSegmentMB=1.208984375, forceMergeDeletesPctAllowed=4.93958120341266, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 472549 T686 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386928548199/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 472549 T686 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 472550 T686 oass.SolrIndexSearcher.<init> Opening Searcher@1fa3c551 main
[junit4] 2> 472554 T687 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1fa3c551 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 472556 T686 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 472557 T686 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36646 collection:control_collection shard:shard1
[junit4] 2> 472557 T686 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 472582 T686 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 472585 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 472585 T686 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 472586 T686 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C283 name=collection1 org.apache.solr.core.SolrCore@7de2d275 url=http://127.0.0.1:36646/collection1 node=127.0.0.1:36646_ C283_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:36646, core=collection1, node_name=127.0.0.1:36646_}
[junit4] 2> 472586 T686 C283 P36646 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36646/collection1/
[junit4] 2> 472586 T684 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 472586 T686 C283 P36646 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 472587 T686 C283 P36646 oasc.SyncStrategy.syncToMe http://127.0.0.1:36646/collection1/ has no replicas
[junit4] 2> 472587 T686 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36646/collection1/ shard1
[junit4] 2> 472587 T686 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 472595 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 472606 T683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 472620 T684 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 472624 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 472730 T683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 472774 T686 oasc.ZkController.register We are http://127.0.0.1:36646/collection1/ and leader is http://127.0.0.1:36646/collection1/
[junit4] 2> 472774 T686 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36646
[junit4] 2> 472774 T686 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 472774 T686 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 472775 T686 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 472776 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 472776 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 472777 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 472777 T686 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 472778 T661 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4] 2> 472779 T661 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 472778 T684 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 472779 T684 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:36646",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:36646_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 472781 T661 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 472788 T690 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3aae6f49 name:ZooKeeperConnection Watcher:127.0.0.1:13292/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 472788 T661 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 472789 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 472790 T661 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 472792 T661 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 472892 T683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 472892 T690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 473118 T661 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 473121 T661 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:12820
[junit4] 2> 473122 T661 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 473123 T661 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 473123 T661 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1386928551434
[junit4] 2> 473124 T661 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1386928551434/'
[junit4] 2> 473167 T661 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1386928551434/solr.xml
[junit4] 2> 473273 T661 oasc.CoreContainer.<init> New CoreContainer 1967149302
[junit4] 2> 473274 T661 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1386928551434/]
[junit4] 2> 473276 T661 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 473276 T661 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 473277 T661 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 473277 T661 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 473278 T661 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 473278 T661 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 473279 T661 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 473279 T661 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 473279 T661 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 473301 T661 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 473301 T661 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 473302 T661 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 473302 T661 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:13292/solr
[junit4] 2> 473303 T661 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 473304 T661 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 473307 T701 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a16aca7 name:ZooKeeperConnection Watcher:127.0.0.1:13292 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 473307 T661 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 473320 T661 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 473322 T703 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@50e2e88f name:ZooKeeperConnection Watcher:127.0.0.1:13292/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 473322 T661 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 473332 T661 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 474335 T661 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:12820_
[junit4] 2> 474341 T661 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:12820_
[junit4] 2> 474344 T703 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 474345 T683 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 474344 T690 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 474366 T704 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 474366 T704 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 474367 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 474367 T704 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 474368 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 474368 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 474369 T684 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 474370 T684 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:12820",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:12820_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 474370 T684 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 474370 T684 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 474373 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 474477 T683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 474477 T703 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 474477 T690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 475369 T704 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 475369 T704 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1386928551434/collection1
[junit4] 2> 475369 T704 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 475370 T704 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 475371 T704 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 475372 T704 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1386928551434/collection1/'
[junit4] 2> 475374 T704 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1386928551434/collection1/lib/README' to classloader
[junit4] 2> 475374 T704 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1386928551434/collection1/lib/classes/' to classloader
[junit4] 2> 475438 T704 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 475518 T704 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 475620 T704 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 475631 T704 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 476190 T704 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 476195 T704 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 476197 T704 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 476203 T704 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 476231 T704 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 476232 T704 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1386928551434/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386928548199/jetty1/
[junit4] 2> 476232 T704 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@61f7ff6c
[junit4] 2> 476234 T704 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386928548199/jetty1
[junit4] 2> 476234 T704 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386928548199/jetty1/index/
[junit4] 2> 476235 T704 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386928548199/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 476237 T704 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386928548199/jetty1/index
[junit4] 2> 476238 T704 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=49.267578125, floorSegmentMB=1.7734375, forceMergeDeletesPctAllowed=11.35500409347196, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.752424645732454
[junit4] 2> 476242 T704 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386928548199/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 476242 T704 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 476248 T704 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 476249 T704 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 476249 T704 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 476250 T704 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 476250 T704 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 476250 T704 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 476251 T704 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 476251 T704 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 476251 T704 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 476252 T704 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 476253 T704 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 476253 T704 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 476254 T704 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 476254 T704 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 476255 T704 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 476256 T704 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 476274 T704 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 476278 T704 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 476279 T704 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 476280 T704 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=82.6240234375, floorSegmentMB=1.208984375, forceMergeDeletesPctAllowed=4.93958120341266, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 476281 T704 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386928548199/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 476282 T704 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 476282 T704 oass.SolrIndexSearcher.<init> Opening Searcher@1b1bd20 main
[junit4] 2> 476287 T705 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b1bd20 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 476291 T704 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 476291 T704 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:12820 collection:collection1 shard:shard2
[junit4] 2> 476292 T704 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 476316 T704 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 476324 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 476324 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 476325 T704 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 476325 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 476325 T704 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C284 name=collection1 org.apache.solr.core.SolrCore@30e08e1 url=http://127.0.0.1:12820/collection1 node=127.0.0.1:12820_ C284_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:12820, core=collection1, node_name=127.0.0.1:12820_}
[junit4] 2> 476325 T704 C284 P12820 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:12820/collection1/
[junit4] 2> 476326 T704 C284 P12820 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 476326 T684 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 476326 T704 C284 P12820 oasc.SyncStrategy.syncToMe http://127.0.0.1:12820/collection1/ has no replicas
[junit4] 2> 476326 T704 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:12820/collection1/ shard2
[junit4] 2> 476327 T704 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 476330 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 476340 T683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 476340 T690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 476340 T703 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 476352 T684 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 476362 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 476464 T703 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 476464 T683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 476464 T690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 476505 T704 oasc.ZkController.register We are http://127.0.0.1:12820/collection1/ and leader is http://127.0.0.1:12820/collection1/
[junit4] 2> 476505 T704 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:12820
[junit4] 2> 476505 T704 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 476506 T704 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 476506 T704 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 476530 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 476530 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 476530 T704 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 476530 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 476532 T661 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4] 2> 476532 T661 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 476532 T684 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 476534 T684 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:12820",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:12820_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 476554 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 476657 T683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 476657 T703 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 476657 T690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 476813 T661 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 476816 T661 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:62557
[junit4] 2> 476817 T661 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 476818 T661 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 476818 T661 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1386928555176
[junit4] 2> 476819 T661 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1386928555176/'
[junit4] 2> 476856 T661 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1386928555176/solr.xml
[junit4] 2> 476948 T661 oasc.CoreContainer.<init> New CoreContainer 1754244349
[junit4] 2> 476949 T661 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1386928555176/]
[junit4] 2> 476950 T661 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 476951 T661 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 476951 T661 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 476952 T661 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 476952 T661 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 476952 T661 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 476953 T661 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 476953 T661 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 476954 T661 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 476975 T661 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 476976 T661 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 476976 T661 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 476977 T661 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:13292/solr
[junit4] 2> 476977 T661 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 476978 T661 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 476981 T717 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48049005 name:ZooKeeperConnection Watcher:127.0.0.1:13292 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 476982 T661 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 476985 T661 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 477000 T719 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@544841c0 name:ZooKeeperConnection Watcher:127.0.0.1:13292/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 477001 T661 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 477012 T661 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 478016 T661 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62557_
[junit4] 2> 478021 T661 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:62557_
[junit4] 2> 478025 T703 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 478025 T690 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 478025 T683 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 478025 T719 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 478041 T720 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 478041 T720 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 478043 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 478043 T720 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 478043 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 478043 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 478045 T684 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 478045 T684 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:62557",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:62557_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 478046 T684 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 478046 T684 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 478049 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 478151 T683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 478151 T703 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 478151 T690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 478151 T719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 479044 T720 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 479044 T720 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1386928555176/collection1
[junit4] 2> 479044 T720 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 479045 T720 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 479046 T720 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 479047 T720 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1386928555176/collection1/'
[junit4] 2> 479048 T720 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1386928555176/collection1/lib/README' to classloader
[junit4] 2> 479049 T720 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1386928555176/collection1/lib/classes/' to classloader
[junit4] 2> 479115 T720 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 479199 T720 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 479302 T720 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 479314 T720 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 479930 T720 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 479934 T720 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 479937 T720 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 479943 T720 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 479968 T720 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 479969 T720 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1386928555176/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386928548199/jetty2/
[junit4] 2> 479969 T720 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@61f7ff6c
[junit4] 2> 479971 T720 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386928548199/jetty2
[junit4] 2> 479972 T720 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386928548199/jetty2/index/
[junit4] 2> 479972 T720 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386928548199/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 479974 T720 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386928548199/jetty2/index
[junit4] 2> 479975 T720 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=49.267578125, floorSegmentMB=1.7734375, forceMergeDeletesPctAllowed=11.35500409347196, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.752424645732454
[junit4] 2> 479979 T720 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386928548199/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 479980 T720 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 479986 T720 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 479987 T720 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 479987 T720 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 479987 T720 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 479988 T720 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 479988 T720 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 479989 T720 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 479989 T720 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 479989 T720 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 479990 T720 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 479991 T720 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 479991 T720 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 479992 T720 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 479992 T720 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 479993 T720 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 479994 T720 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 480013 T720 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 480017 T720 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 480018 T720 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 480019 T720 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=82.6240234375, floorSegmentMB=1.208984375, forceMergeDeletesPctAllowed=4.93958120341266, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 480021 T720 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1386928548199/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 480021 T720 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 480022 T720 oass.SolrIndexSearcher.<init> Opening Searcher@66fc73af main
[junit4] 2> 480027 T721 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@66fc73af main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 480030 T720 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 480030 T720 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:62557 collection:collection1 shard:shard1
[junit4] 2> 480031 T720 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 480049 T720 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 480052 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 480052 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 480053 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 480053 T720 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 480053 T720 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C285 name=collection1 org.apache.solr.core.SolrCore@75d21c8b url=http://127.0.0.1:62557/collection1 node=127.0.0.1:62557_ C285_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:62557, core=collection1, node_name=127.0.0.1:62557_}
[junit4] 2> 480053 T720 C285 P62557 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:62557/collection1/
[junit4] 2> 480054 T720 C285 P62557 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 480054 T684 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 480054 T720 C285 P62557 oasc.SyncStrategy.syncToMe http://127.0.0.1:62557/collection1/ has no replicas
[junit4] 2> 480054 T720 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:62557/collection1/ shard1
[junit4] 2> 480055 T720 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 480065 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 480066 T683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 480067 T703 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 480066 T719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 480066 T690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 480077 T684 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 480085 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 480196 T683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 480197 T719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 480196 T703 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 480196 T690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 480230 T720 oasc.ZkController.register We are http://127.0.0.1:62557/collection1/ and leader is http://127.0.0.1:62557/collection1/
[junit4] 2> 480230 T720 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:62557
[junit4] 2> 480230 T720 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 480230 T720 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 480231 T720 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 480232 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 480232 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 480233 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 480233 T720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 480234 T684 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 480234 T661 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4] 2> 480235 T661 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 480235 T684 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:62557",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:62557_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 480238 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 480341 T683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 480341 T703 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 480341 T690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 480341 T719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 480550 T661 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 480553 T661 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:65390
[junit4] 2> 480555 T661 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 480555 T661 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 480556 T661 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1386928558878
[junit4] 2> 480556 T661 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1386928558878/'
[junit4] 2> 480597 T661 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1386928558878/solr.xml
[junit4] 2> 480702 T661 oasc.CoreContainer.<init> New CoreContainer 1607748684
[junit4] 2> 480703 T661 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1386928558878/]
[junit4] 2> 480705 T661 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 480705 T661 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 480706 T661 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 480706 T661 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 480706 T661 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 480707 T661 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 480707 T661 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 480708 T661 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 480708 T661 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 480729 T661 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 480730 T661 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 480730 T661 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 480731 T661 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:13292/solr
[junit4] 2> 480731 T661 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 480732 T661 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 480735 T733 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@69f313c8 name:ZooKeeperConnection Watcher:127.0.0.1:13292 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 480736 T661 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 480746 T661 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 480748 T735 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2409d07 name:ZooKeeperConnection Watcher:127.0.0.1:13292/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 480749 T661 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 480757 T661 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 481760 T661 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65390_
[junit4] 2> 481762 T661 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65390_
[junit4] 2> 481766 T690 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 481766 T703 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 481766 T735 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 481766 T683 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 481766 T719 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 481808 T736 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 481808 T736 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 481810 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 481810 T736 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 481810 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 481810 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 481812 T684 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 481813 T684 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:65390",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:65390_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 481813 T684 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 481813 T684 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 481817 T683 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 481923 T690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 481923 T683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 481923 T703 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 481923 T719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 481923 T735 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 482811 T736 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 482811 T736 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1386928558878/collection1
[junit4] 2> 482811 T736 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 482812 T736 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 482813 T736 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 482814 T736 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1386928558878/collection1/'
[junit4] 2> 482816 T736 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1386928558878/collection1/lib/classes/' to classloader
[junit4] 2> 482817 T736 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1386928558878/collection1/lib/README' to classloader
[junit4] 2> 482888 T736 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 482977 T736 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 483080 T736 oass.IndexSchema.readSchema Reading Solr Schema from sche
[...truncated too long message...]
5 T4341 oas.SolrTestCaseJ4.tearDown ###Ending testQueryBoost
[junit4] 2> 2502360 T4341 oas.SolrTestCaseJ4.setUp ###Starting testFuncGhhsin
[junit4] 2> 2502361 T4341 oas.SolrTestCaseJ4.tearDown ###Ending testFuncGhhsin
[junit4] 2> 2502366 T4341 oas.SolrTestCaseJ4.setUp ###Starting testFuncMs
[junit4] 2> 2502368 T4341 oas.SolrTestCaseJ4.tearDown ###Ending testFuncMs
[junit4] 2> 2502373 T4341 oas.SolrTestCaseJ4.setUp ###Starting testQueryLucenePlusSort
[junit4] 2> 2502376 T4341 oas.SolrTestCaseJ4.tearDown ###Ending testQueryLucenePlusSort
[junit4] 2> 2502381 T4341 oas.SolrTestCaseJ4.setUp ###Starting testFuncNorm
[junit4] 2> 2502391 T4341 oas.SolrTestCaseJ4.tearDown ###Ending testFuncNorm
[junit4] 2> 2502396 T4341 oas.SolrTestCaseJ4.setUp ###Starting testQueryDismax
[junit4] 2> 2502404 T4341 oas.SolrTestCaseJ4.tearDown ###Ending testQueryDismax
[junit4] 2> 2502409 T4341 oas.SolrTestCaseJ4.setUp ###Starting testFuncProduct
[junit4] 2> 2502411 T4341 oas.SolrTestCaseJ4.tearDown ###Ending testFuncProduct
[junit4] 2> 2502416 T4341 oas.SolrTestCaseJ4.setUp ###Starting testFuncMin
[junit4] 2> 2502418 T4341 oas.SolrTestCaseJ4.tearDown ###Ending testFuncMin
[junit4] 2> 2502423 T4341 oas.SolrTestCaseJ4.setUp ###Starting testFuncBoost
[junit4] 2> 2502425 T4341 oas.SolrTestCaseJ4.tearDown ###Ending testFuncBoost
[junit4] 2> 2502430 T4341 oas.SolrTestCaseJ4.setUp ###Starting testFuncSingleValueMathFuncs
[junit4] 2> 2502438 T4341 oas.SolrTestCaseJ4.tearDown ###Ending testFuncSingleValueMathFuncs
[junit4] 2> 2502443 T4341 oas.SolrTestCaseJ4.setUp ###Starting testQueryRaw
[junit4] 2> 2502444 T4341 oas.SolrTestCaseJ4.tearDown ###Ending testQueryRaw
[junit4] 2> 2502448 T4341 oas.SolrTestCaseJ4.setUp ###Starting testQueryFrange
[junit4] 2> 2502449 T4341 oas.SolrTestCaseJ4.tearDown ###Ending testQueryFrange
[junit4] 2> 2502453 T4341 oas.SolrTestCaseJ4.setUp ###Starting testFuncMap
[junit4] 2> 2502464 T4341 oas.SolrTestCaseJ4.tearDown ###Ending testFuncMap
[junit4] 2> 2502469 T4341 oas.SolrTestCaseJ4.setUp ###Starting testFuncSub
[junit4] 2> 2502470 T4341 oas.SolrTestCaseJ4.tearDown ###Ending testFuncSub
[junit4] 2> 2502472 T4341 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 2502472 T4341 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=608865272
[junit4] 2> 2502472 T4341 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@2ff13ab1
[junit4] 2> 2502489 T4341 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
[junit4] 2> 2502489 T4341 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2502490 T4341 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2502490 T4341 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2502491 T4341 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 2502491 T4341 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2502491 T4341 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-QueryEqualityTest-1386930582105 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-QueryEqualityTest-1386930582105;done=false>>]
[junit4] 2> 2502492 T4341 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-QueryEqualityTest-1386930582105
[junit4] 2> 2502492 T4341 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-QueryEqualityTest-1386930582105/index [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-QueryEqualityTest-1386930582105/index;done=false>>]
[junit4] 2> 2502492 T4341 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-QueryEqualityTest-1386930582105/index
[junit4] 2> NOTE: test params are: codec=Lucene46: {}, docValues:{}, sim=DefaultSimilarity, locale=bg_BG, timezone=Europe/Vatican
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=1,free=383304152,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [PluginInfoTest, FullSolrCloudDistribCmdsTest, TestWriterPerf, BasicFunctionalityTest, TestNoOpRegenerator, DirectUpdateHandlerOptimizeTest, TestFastLRUCache, TestSimpleQParserPlugin, TestCloudManagedSchemaAddField, TestUpdate, TestCollapseQParserPlugin, JsonLoaderTest, TestSolrDeletionPolicy2, TestReplicationHandler, TestStressReorder, TestRandomDVFaceting, CacheHeaderTest, TestSystemIdResolver, TestStressRecovery, TestJmxIntegration, BadIndexSchemaTest, TestClassNameShortening, BadCopyFieldTest, TestAtomicUpdateErrorCases, TestSweetSpotSimilarityFactory, DocumentAnalysisRequestHandlerTest, TestJoin, TestCoreDiscovery, PingRequestHandlerTest, EnumFieldTest, CircularListTest, ZkNodePropsTest, OpenCloseCoreStressTest, LoggingHandlerTest, TestSerializedLuceneMatchVersion, BlockDirectoryTest, TestFastWriter, TestLazyCores, ScriptEngineTest, TestFileDictionaryLookup, TestExtendedDismaxParser, TestMultiCoreConfBootstrap, TestXIncludeConfig, ResourceLoaderTest, TestUniqueKeyFieldResource, PrimUtilsTest, TestGroupingSearch, CachingDirectoryFactoryTest, HdfsUnloadDistributedZkTest, SuggesterTest, DistributedSpellCheckComponentTest, TestFieldCollectionResource, TestRTGBase, RequestHandlersTest, TestZkChroot, LegacyHTMLStripCharFilterTest, TestIBSimilarityFactory, TestSolrIndexConfig, SpellCheckComponentTest, TimeZoneUtilsTest, TestDynamicFieldCollectionResource, UpdateRequestProcessorFactoryTest, TestStressLucene, SolrCoreTest, OverseerCollectionProcessorTest, SolrCmdDistributorTest, TestIndexSearcher, TestLFUCache, TestFieldTypeCollectionResource, SolrInfoMBeanTest, TestCollationKeyRangeQueries, QueryResultKeyTest, CurrencyFieldOpenExchangeTest, TestDefaultSearchFieldResource, TestBinaryField, SyncSliceTest, JSONWriterTest, TestBadConfig, TestNonNRTOpen, TestHighFrequencyDictionaryFactory, TestSurroundQueryParser, SignatureUpdateProcessorFactoryTest, TestSolrQueryParser, DOMUtilTest, UpdateParamsTest, BasicDistributedZk2Test, TriLevelCompositeIdRoutingTest, MigrateRouteKeyTest, ShardRoutingTest, RecoveryZkTest, DeleteReplicaTest, TestDocBasedVersionConstraints, TestHashPartitioner, TestFaceting, DeleteShardTest, TestManagedSchemaFieldResource, LeaderElectionTest, SoftAutoCommitTest, ZkSolrClientTest, TestRangeQuery, TestSolr4Spatial, DirectUpdateHandlerTest, TestSort, ConvertedLegacyTest, TestReloadAndDeleteDocs, DocValuesMissingTest, CoreAdminHandlerTest, SolrXmlInZkTest, SchemaVersionSpecificBehaviorTest, SolrCoreCheckLockOnStartupTest, SuggesterWFSTTest, SpatialFilterTest, SolrRequestParserTest, TestWordDelimiterFilterFactory, TestCSVLoader, DefaultValueUpdateProcessorTest, QueryEqualityTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=QueryEqualityTest -Dtests.seed=4C9321D745133B4F -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=bg_BG -Dtests.timezone=Europe/Vatican -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s J0 | QueryEqualityTest (suite) <<<
[junit4] > Throwable #1: java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing val parser: concat
[junit4] > at __randomizedtesting.SeedInfo.seed([4C9321D745133B4F]:0)
[junit4] > at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:65)
[junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4] Completed on J0 in 2.24s, 67 tests, 1 failure <<< FAILURES!
[...truncated 320 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:459: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:439: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:491: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1307: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:940: There were test failures: 347 suites, 1517 tests, 1 suite-level error, 1 failure, 34 ignored (6 assumptions)
Total time: 68 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure