You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/12/25 17:55:52 UTC
[JENKINS] Lucene-Solr-5.x-MacOSX (64bit/jdk1.8.0) - Build # 1971 -
Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-MacOSX/1971/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseG1GC (asserts: false)
1 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.testDistribSearch
Error Message:
There were too many update fails - we expect it can happen, but shouldn't easily
Stack Trace:
java.lang.AssertionError: There were too many update fails - we expect it can happen, but shouldn't easily
at __randomizedtesting.SeedInfo.seed([663E0C429B5621D6:E7D8825AEC0941EA]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertFalse(Assert.java:68)
at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.doTest(ChaosMonkeyNothingIsSafeTest.java:223)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
at sun.reflect.GeneratedMethodAccessor57.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 9935 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/init-core-data-001
[junit4] 2> 4918621 T12924 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /o_fq/b
[junit4] 2> 4918663 T12924 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 4918664 T12924 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 4918666 T12925 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 4918767 T12924 oasc.ZkTestServer.run start zk server on port:59779
[junit4] 2> 4918807 T12924 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 4918823 T12924 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4918833 T12932 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@777663e9 name:ZooKeeperConnection Watcher:127.0.0.1:59779 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4918834 T12924 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4918835 T12924 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 4918835 T12924 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 4918847 T12924 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 4918850 T12924 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4918854 T12935 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f6de20e name:ZooKeeperConnection Watcher:127.0.0.1:59779/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4918854 T12924 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4918854 T12924 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 4918855 T12924 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 4918910 T12924 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 4918951 T12924 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 4918998 T12924 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 4919025 T12924 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 4919026 T12924 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 4919042 T12924 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 4919044 T12924 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 4919052 T12924 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 4919054 T12924 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 4919065 T12924 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 4919066 T12924 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 4919073 T12924 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 4919074 T12924 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 4919080 T12924 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 4919081 T12924 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 4919089 T12924 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 4919090 T12924 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 4919104 T12924 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 4919105 T12924 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 4919115 T12924 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 4919117 T12924 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 4919125 T12924 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 4919126 T12924 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 4919132 T12924 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 4919133 T12924 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 4921173 T12924 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 4921177 T12924 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59782
[junit4] 2> 4921178 T12924 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
[junit4] 2> 4921179 T12924 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 4921179 T12924 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-002
[junit4] 2> 4921180 T12924 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-002/'
[junit4] 2> 4921233 T12924 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-002/solr.xml
[junit4] 2> 4921254 T12924 oasc.CoreContainer.<init> New CoreContainer 1000457734
[junit4] 2> 4921254 T12924 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-002/]
[junit4] 2> 4921255 T12924 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 4921256 T12924 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 4921256 T12924 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 4921257 T12924 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 4921257 T12924 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 4921257 T12924 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 4921258 T12924 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 4921259 T12924 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 4921259 T12924 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 4921260 T12924 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 4921260 T12924 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 4921261 T12924 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 4921261 T12924 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 4921261 T12924 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 4921262 T12924 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59779/solr
[junit4] 2> 4921263 T12924 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 4921263 T12924 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 4921264 T12924 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4921268 T12947 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@59652d21 name:ZooKeeperConnection Watcher:127.0.0.1:59779 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4921269 T12924 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4921269 T12924 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 4921273 T12924 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4921276 T12950 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@762b43fd name:ZooKeeperConnection Watcher:127.0.0.1:59779/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4921276 T12924 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4921279 T12924 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 4921286 T12924 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 4921293 T12924 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 4921300 T12924 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 4921307 T12924 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 4921315 T12924 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 4921318 T12924 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59782_o_fq%2Fb
[junit4] 2> 4921319 T12924 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59782_o_fq%2Fb
[junit4] 2> 4921327 T12924 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 4921331 T12924 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 4921335 T12924 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 4921344 T12924 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:59782_o_fq%2Fb
[junit4] 2> 4921344 T12924 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 4921350 T12924 oasc.Overseer.start Overseer (id=93029895993032707-127.0.0.1:59782_o_fq%2Fb-n_0000000000) starting
[junit4] 2> 4921354 T12924 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 4921380 T12924 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 4921382 T12952 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 4921385 T12924 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 4921393 T12924 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 4921397 T12924 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 4921410 T12951 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 4921415 T12954 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 4921416 T12954 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 4921417 T12950 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 4921418 T12954 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 4921428 T12951 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 0, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:59782/o_fq/b",
[junit4] 2> "node_name":"127.0.0.1:59782_o_fq%2Fb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 4921429 T12951 oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:59782/o_fq/b",
[junit4] 2> "node_name":"127.0.0.1:59782_o_fq%2Fb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 4921430 T12951 oasco.ClusterStateMutator.createCollection building a new cName: control_collection
[junit4] 2> 4921430 T12951 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 4921433 T12950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 4922419 T12954 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 4922419 T12954 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 4922421 T12954 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 4922421 T12954 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 4922424 T12954 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 4922424 T12954 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-002/collection1/'
[junit4] 2> 4922425 T12954 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 4922426 T12954 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 4922426 T12954 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 4922467 T12954 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 4922473 T12954 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 4922491 T12954 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 4922504 T12954 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 4922508 T12954 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 4922518 T12954 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 4922850 T12954 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 4922853 T12954 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 4922854 T12954 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 4922862 T12954 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 4922934 T12954 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 4922935 T12954 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 4922935 T12954 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-002/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-001/control/data/
[junit4] 2> 4922936 T12954 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4cae5d76
[junit4] 2> 4922941 T12954 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-001/control/data
[junit4] 2> 4922942 T12954 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-001/control/data/index/
[junit4] 2> 4922943 T12954 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 4922945 T12954 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-001/control/data/index
[junit4] 2> 4922946 T12954 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=17, maxMergedSegmentMB=31.685546875, floorSegmentMB=1.4345703125, forceMergeDeletesPctAllowed=28.945407216669548, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7542499011090168
[junit4] 2> 4922950 T12954 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 4922952 T12954 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 4922959 T12954 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 4922960 T12954 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 4922961 T12954 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 4922961 T12954 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 4922962 T12954 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 4922962 T12954 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 4922963 T12954 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 4922963 T12954 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 4922964 T12954 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 4922965 T12954 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 4922965 T12954 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 4922966 T12954 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 4922966 T12954 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 4922967 T12954 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 4922969 T12954 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
[junit4] 2> 4922970 T12954 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 4922971 T12954 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 4922972 T12954 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 4922973 T12954 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 4922974 T12954 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 4922975 T12954 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 4922976 T12954 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 4922977 T12954 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 4922977 T12954 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 4922979 T12954 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 4922980 T12954 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 4922981 T12954 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 4922982 T12954 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 4922995 T12954 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 4922998 T12954 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 4923002 T12954 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 4923005 T12954 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 4923007 T12954 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 4923008 T12954 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 4923009 T12954 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=62.1953125, floorSegmentMB=0.755859375, forceMergeDeletesPctAllowed=26.561792812633705, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1822956038811464
[junit4] 2> 4923013 T12954 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 4923013 T12954 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 4923014 T12954 oass.SolrIndexSearcher.<init> Opening Searcher@5439e4fb[collection1] main
[junit4] 2> 4923014 T12954 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 4923036 T12954 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 4923037 T12954 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 4923042 T12954 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 4923042 T12954 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 4923042 T12954 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 4923044 T12954 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 4923045 T12954 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 4923045 T12954 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 4923045 T12954 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 4923046 T12955 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5439e4fb[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 4923047 T12954 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 4923052 T12958 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59782/o_fq/b collection:control_collection shard:shard1
[junit4] 2> 4923055 T12924 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 4923055 T12924 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 4923057 T12924 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 4923061 T12924 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4923064 T12958 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 4923066 T12961 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d18d28c name:ZooKeeperConnection Watcher:127.0.0.1:59779/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4923067 T12924 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4923068 T12924 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 4923078 T12924 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 4923095 T12924 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 4923125 T12958 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 4923137 T12950 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 4923139 T12958 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 4923140 T12958 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1805 name=collection1 org.apache.solr.core.SolrCore@5b45ba47 url=http://127.0.0.1:59782/o_fq/b/collection1 node=127.0.0.1:59782_o_fq%2Fb C1805_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=http://127.0.0.1:59782/o_fq/b, node_name=127.0.0.1:59782_o_fq%2Fb, state=down}
[junit4] 2> 4923140 T12958 C1805 P59782 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59782/o_fq/b/collection1/
[junit4] 2> 4923141 T12958 C1805 P59782 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 4923143 T12958 C1805 P59782 oasc.SyncStrategy.syncToMe http://127.0.0.1:59782/o_fq/b/collection1/ has no replicas
[junit4] 2> 4923143 T12958 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59782/o_fq/b/collection1/ shard1
[junit4] 2> 4923144 T12958 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 4923147 T12951 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 4923161 T12961 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 4923162 T12950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 4923198 T12951 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:59782/o_fq/b",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 2
[junit4] 2> 4923204 T12962 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 4923311 T12961 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 4923345 T12958 oasc.ZkController.register We are http://127.0.0.1:59782/o_fq/b/collection1/ and leader is http://127.0.0.1:59782/o_fq/b/collection1/
[junit4] 2> 4923346 T12958 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59782/o_fq/b
[junit4] 2> 4923346 T12958 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 4923348 T12958 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 4923350 T12958 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 4923359 T12950 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 4923374 T12951 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:59782/o_fq/b",
[junit4] 2> "node_name":"127.0.0.1:59782_o_fq%2Fb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 4923377 T12951 oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:59782/o_fq/b",
[junit4] 2> "node_name":"127.0.0.1:59782_o_fq%2Fb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 4923512 T12961 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 4923513 T12950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 4924891 T12924 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 4924892 T12924 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 4924897 T12924 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59786
[junit4] 2> 4924899 T12924 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
[junit4] 2> 4924900 T12924 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 4924900 T12924 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-003
[junit4] 2> 4924901 T12924 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-003/'
[junit4] 2> 4924945 T12924 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-003/solr.xml
[junit4] 2> 4924963 T12924 oasc.CoreContainer.<init> New CoreContainer 1423101183
[junit4] 2> 4924982 T12924 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-003/]
[junit4] 2> 4924983 T12924 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 4924984 T12924 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 4924984 T12924 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 4924984 T12924 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 4924984 T12924 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 4924985 T12924 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 4924985 T12924 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 4924986 T12924 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 4924986 T12924 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 4924986 T12924 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 4924987 T12924 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 4924987 T12924 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 4924988 T12924 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 4924988 T12924 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 4924988 T12924 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59779/solr
[junit4] 2> 4924989 T12924 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 4924990 T12924 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 4924991 T12924 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4924996 T12974 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3050da1 name:ZooKeeperConnection Watcher:127.0.0.1:59779 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4924997 T12924 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4924997 T12924 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 4925003 T12924 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4925006 T12977 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a12eb4 name:ZooKeeperConnection Watcher:127.0.0.1:59779/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4925007 T12924 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4925026 T12924 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 4926038 T12924 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59786_o_fq%2Fb
[junit4] 2> 4926041 T12924 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59786_o_fq%2Fb
[junit4] 2> 4926055 T12924 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 4926069 T12978 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 4926070 T12978 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 4926071 T12950 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 4926071 T12978 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 4926073 T12951 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:59786/o_fq/b",
[junit4] 2> "node_name":"127.0.0.1:59786_o_fq%2Fb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 4
[junit4] 2> 4926074 T12951 oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:59786/o_fq/b",
[junit4] 2> "node_name":"127.0.0.1:59786_o_fq%2Fb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 4926075 T12951 oasco.ClusterStateMutator.createCollection building a new cName: collection1
[junit4] 2> 4926075 T12951 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 4926077 T12950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 4926081 T12961 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 4926085 T12977 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 4927073 T12978 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 4927073 T12978 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 4927075 T12978 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 4927076 T12978 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 4927080 T12978 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 4927080 T12978 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-003/collection1/'
[junit4] 2> 4927082 T12978 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 4927082 T12978 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 4927083 T12978 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 4927135 T12978 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 4927142 T12978 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 4927157 T12978 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 4927168 T12978 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 4927175 T12978 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 4927183 T12978 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 4927397 T12978 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 4927399 T12978 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 4927400 T12978 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 4927406 T12978 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 4927471 T12978 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 4927472 T12978 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 4927473 T12978 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-003/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-001/jetty1/
[junit4] 2> 4927473 T12978 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4cae5d76
[junit4] 2> 4927474 T12978 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-001/jetty1
[junit4] 2> 4927476 T12978 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-001/jetty1/index/
[junit4] 2> 4927477 T12978 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 4927480 T12978 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-001/jetty1/index
[junit4] 2> 4927481 T12978 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=17, maxMergedSegmentMB=31.685546875, floorSegmentMB=1.4345703125, forceMergeDeletesPctAllowed=28.945407216669548, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7542499011090168
[junit4] 2> 4927487 T12978 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 4927487 T12978 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 4927499 T12978 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 4927500 T12978 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 4927501 T12978 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 4927501 T12978 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 4927502 T12978 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 4927502 T12978 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 4927504 T12978 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 4927505 T12978 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 4927506 T12978 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 4927508 T12978 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 4927508 T12978 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 4927509 T12978 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 4927510 T12978 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 4927511 T12978 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 4927512 T12978 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
[junit4] 2> 4927515 T12978 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 4927516 T12978 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 4927516 T12978 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 4927521 T12978 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 4927521 T12978 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 4927522 T12978 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 4927522 T12978 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 4927523 T12978 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 4927523 T12978 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 4927524 T12978 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 4927525 T12978 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 4927526 T12978 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 4927526 T12978 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 4927535 T12978 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 4927538 T12978 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 4927540 T12978 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 4927541 T12978 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 4927544 T12978 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 4927545 T12978 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 4927548 T12978 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=62.1953125, floorSegmentMB=0.755859375, forceMergeDeletesPctAllowed=26.561792812633705, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1822956038811464
[junit4] 2> 4927550 T12978 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 4927551 T12978 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 4927551 T12978 oass.SolrIndexSearcher.<init> Opening Searcher@21752ace[collection1] main
[junit4] 2> 4927553 T12978 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 4927556 T12978 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 4927557 T12978 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 4927559 T12978 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 4927559 T12978 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 4927560 T12978 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 4927561 T12978 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 4927562 T12978 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 4927562 T12978 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 4927562 T12978 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 4927563 T12979 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@21752ace[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 4927564 T12978 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 4927566 T12982 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59786/o_fq/b collection:collection1 shard:shard1
[junit4] 2> 4927567 T12924 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 4927568 T12924 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 4927570 T12982 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 4927585 T12982 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 4927592 T12950 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 4927592 T12982 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 4927594 T12982 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1806 name=collection1 org.apache.solr.core.SolrCore@3aff402b url=http://127.0.0.1:59786/o_fq/b/collection1 node=127.0.0.1:59786_o_fq%2Fb C1806_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:59786/o_fq/b, node_name=127.0.0.1:59786_o_fq%2Fb, state=down}
[junit4] 2> 4927594 T12982 C1806 P59786 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59786/o_fq/b/collection1/
[junit4] 2> 4927594 T12982 C1806 P59786 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 4927595 T12982 C1806 P59786 oasc.SyncStrategy.syncToMe http://127.0.0.1:59786/o_fq/b/collection1/ has no replicas
[junit4] 2> 4927595 T12982 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59786/o_fq/b/collection1/ shard1
[junit4] 2> 4927596 T12982 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 4927603 T12951 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1"} current state version: 5
[junit4] 2> 4927612 T12977 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 4927614 T12950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 4927615 T12961 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 4927666 T12962 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 4927671 T12951 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:59786/o_fq/b",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 6
[junit4] 2> 4927783 T12961 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 4927783 T12977 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 4927827 T12982 oasc.ZkController.register We are http://127.0.0.1:59786/o_fq/b/collection1/ and leader is http://127.0.0.1:59786/o_fq/b/collection1/
[junit4] 2> 4927829 T12982 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59786/o_fq/b
[junit4] 2> 4927831 T12982 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 4927831 T12982 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 4927832 T12982 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 4927844 T12950 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 4927866 T12951 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:59786/o_fq/b",
[junit4] 2> "node_name":"127.0.0.1:59786_o_fq%2Fb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 7
[junit4] 2> 4927869 T12951 oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:59786/o_fq/b",
[junit4] 2> "node_name":"127.0.0.1:59786_o_fq%2Fb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 4927982 T12950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 4927982 T12977 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 4927982 T12961 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 4929746 T12924 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 4929749 T12924 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 4929755 T12924 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59789
[junit4] 2> 4929756 T12924 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
[junit4] 2> 4929757 T12924 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 4929757 T12924 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-004
[junit4] 2> 4929758 T12924 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-004/'
[junit4] 2> 4929808 T12924 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-004/solr.xml
[junit4] 2> 4929825 T12924 oasc.CoreContainer.<init> New CoreContainer 592030836
[junit4] 2> 4929826 T12924 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-004/]
[junit4] 2> 4929827 T12924 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 4929827 T12924 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 4929827 T12924 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 4929828 T12924 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 4929828 T12924 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 4929829 T12924 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 4929829 T12924 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 4929830 T12924 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 4929832 T12924 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 4929832 T12924 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 4929833 T12924 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 4929833 T12924 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 4929833 T12924 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 4929834 T12924 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 4929834 T12924 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59779/solr
[junit4] 2> 4929835 T12924 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 4929835 T12924 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 4929836 T12924 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4929840 T12994 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6c4a632b name:ZooKeeperConnection Watcher:127.0.0.1:59779 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4929841 T12924 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4929841 T12924 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 4929848 T12924 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4929850 T12997 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@247453a0 name:ZooKeeperConnection Watcher:127.0.0.1:59779/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4929850 T12924 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4929865 T12924 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 4930879 T12924 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59789_o_fq%2Fb
[junit4] 2> 4930882 T12924 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59789_o_fq%2Fb
[junit4] 2> 4930894 T12924 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 4930905 T12998 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 4930906 T12998 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 4930908 T12950 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 4930908 T12998 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 4930912 T12951 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:59789/o_fq/b",
[junit4] 2> "node_name":"127.0.0.1:59789_o_fq%2Fb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 8
[junit4] 2> 4930913 T12951 oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:59789/o_fq/b",
[junit4] 2> "node_name":"127.0.0.1:59789_o_fq%2Fb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 4930914 T12951 oasco.ReplicaMutator.updateState Collection already exists with numShards=1
[junit4] 2> 4930914 T12951 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 4930919 T12977 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 4930919 T12950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 4930919 T12961 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 4930919 T12997 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 4931909 T12998 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 4931910 T12998 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 4931913 T12998 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 4931913 T12998 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 4931916 T12998 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 4931916 T12998 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-004/collection1/'
[junit4] 2> 4931918 T12998 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 4931919 T12998 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 4931920 T12998 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 4931975 T12998 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 4931981 T12998 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 4932003 T12998 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 4932016 T12998 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 4932021 T12998 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 4932030 T12998 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 4932265 T12998 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 4932268 T12998 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 4932269 T12998 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 4932275 T12998 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 4932330 T12998 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 4932330 T12998 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 4932331 T12998 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-004/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-001/jetty2/
[junit4] 2> 4932331 T12998 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4cae5d76
[junit4] 2> 4932333 T12998 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-001/jetty2
[junit4] 2> 4932333 T12998 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-001/jetty2/index/
[junit4] 2> 4932334 T12998 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 4932336 T12998 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-001/jetty2/index
[junit4] 2> 4932337 T12998 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=17, maxMergedSegmentMB=31.685546875, floorSegmentMB=1.4345703125, forceMergeDeletesPctAllowed=28.945407216669548, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7542499011090168
[junit4] 2> 4932340 T12998 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 4932341 T12998 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 4932348 T12998 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 4932348 T12998 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 4932349 T12998 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 4932349 T12998 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 4932349 T12998 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 4932350 T12998 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 4932350 T12998 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 4932350 T12998 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 4932351 T12998 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 4932351 T12998 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 4932352 T12998 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 4932352 T12998 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 4932353 T12998 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 4932353 T12998 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 4932354 T12998 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
[junit4] 2> 4932360 T12998 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 4932361 T12998 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 4932361 T12998 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 4932362 T12998 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 4932363 T12998 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 4932364 T12998 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 4932364 T12998 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 4932366 T12998 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 4932367 T12998 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 4932368 T12998 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 4932370 T12998 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 4932371 T12998 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 4932372 T12998 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 4932379 T12998 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 4932381 T12998 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 4932382 T12998 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 4932383 T12998 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 4932385 T12998 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 4932385 T12998 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 4932389 T12998 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=62.1953125, floorSegmentMB=0.755859375, forceMergeDeletesPctAllowed=26.561792812633705, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1822956038811464
[junit4] 2> 4932391 T12998 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 4932391 T12998 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 4932391 T12998 oass.SolrIndexSearcher.<init> Opening Searcher@45c5e5d2[collection1] main
[junit4] 2> 4932391 T12998 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 4932394 T12998 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 4932395 T12998 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 4932396 T12998 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 4932396 T12998 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 4932397 T12998 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 4932398 T12998 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 4932398 T12998 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 4932399 T12998 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 4932399 T12998 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 4932401 T12999 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@45c5e5d2[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 4932402 T12998 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 4932404 T13002 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59789/o_fq/b collection:collection1 shard:shard1
[junit4] 2> 4932405 T12924 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 4932405 T12924 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 4932415 T13002 oasc.ZkController.register We are http://127.0.0.1:59789/o_fq/b/collection1/ and leader is http://127.0.0.1:59786/o_fq/b/collection1/
[junit4] 2> 4932415 T13002 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59789/o_fq/b
[junit4] 2> 4932415 T13002 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4] 2> 4932416 T13002 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> ASYNC NEW_CORE C1807 name=collection1 org.apache.solr.core.SolrCore@373eddc url=http://127.0.0.1:59789/o_fq/b/collection1 node=127.0.0.1:59789_o_fq%2Fb C1807_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:59789/o_fq/b, node_name=127.0.0.1:59789_o_fq%2Fb, state=down}
[junit4] 2> 4932418 T13003 C1807 P59789 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4] 2> 4932418 T12924 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):330
[junit4] 2> 4932420 T13003 C1807 P59789 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 4932422 T13003 C1807 P59789 oasc.RecoveryStrategy.doRecovery Publishing state of core collection1 as recovering, leader is http://127.0.0.1:59786/o_fq/b/collection1/ and I am http://127.0.0.1:59789/o_fq/b/collection1/
[junit4] 2> 4932422 T13003 C1807 P59789 oasc.ZkController.publish publishing core=collection1 state=recovering collection=collection1
[junit4] 2> 4932422 T13003 C1807 P59789 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 4932426 T12950 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 4932427 T13003 C1807 P59789 oasc.RecoveryStrategy.sendPrepRecoveryCmd Sending prep recovery command to http://127.0.0.1:59786/o_fq/b; WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1%3A59789_o_fq%252Fb&coreNodeName=core_node2&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true
[junit4] 2> 4932435 T12966 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
[junit4] 2> 4932436 T12951 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:59789/o_fq/b",
[junit4] 2> "node_name":"127.0.0.1:59789_o_fq%2Fb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"recovering",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 9
[junit4] 2> 4932438 T12951 oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:59789/o_fq/b",
[junit4] 2> "node_name":"127.0.0.1:59789_o_fq%2Fb",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"recovering",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 4932443 T12950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[ju
[...truncated too long message...]
hread.java:745)
[junit4] 2> 4966206 T12924 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-663E0C429B5621D6-001
[junit4] 2> 47594 T12923 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=en_US, timezone=Singapore
[junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.8.0_20 (64-bit)/cpus=2,threads=1,free=286600600,total=530579456
[junit4] 2> NOTE: All tests run in this JVM: [LeaderElectionTest, SolrCoreCheckLockOnStartupTest, ZkCLITest, TestModifyConfFiles, OverriddenZkACLAndCredentialsProvidersTest, HdfsBasicDistributedZk2Test, TestFieldResource, SolrRequestParserTest, TestCursorMarkWithoutUniqueKey, TestTolerantSearch, TestBlobHandler, TestCSVResponseWriter, TestSolr4Spatial, OverseerRolesTest, DistribDocExpirationUpdateProcessorTest, ParsingFieldUpdateProcessorsTest, TestCharFilters, TestFileDictionaryLookup, SpellingQueryConverterTest, NoCacheHeaderTest, SyncSliceTest, TestFiltering, SolrIndexConfigTest, TestStressUserVersions, TriLevelCompositeIdRoutingTest, QueryElevationComponentTest, ZkStateWriterTest, SampleTest, DistributedExpandComponentTest, IndexSchemaTest, XsltUpdateRequestHandlerTest, OverseerCollectionProcessorTest, TestLMDirichletSimilarityFactory, DistanceFunctionTest, TestValueSourceCache, SpellCheckComponentTest, OpenExchangeRatesOrgProviderTest, TestBM25SimilarityFactory, SolrInfoMBeanTest, TestDocBasedVersionConstraints, NotRequiredUniqueKeyTest, TestJmxIntegration, BJQParserTest, ConvertedLegacyTest, TestQueryTypes, FastVectorHighlighterTest, PrimitiveFieldTypeTest, ScriptEngineTest, FileUtilsTest, ModifyConfFileTest, TestMaxScoreQueryParser, DOMUtilTest, TestQueryUtils, CoreMergeIndexesAdminHandlerTest, CloudExitableDirectoryReaderTest, TestDFRSimilarityFactory, TestInitQParser, TestSolrXmlPersistor, CloudMLTQParserTest, DistributedFacetPivotLongTailTest, HdfsBasicDistributedZkTest, TestCloudPivotFacet, TestSystemIdResolver, AddSchemaFieldsUpdateProcessorFactoryTest, TestMissingGroups, TestSolrJ, TestCloudManagedSchema, SolrCmdDistributorTest, ClusterStateUpdateTest, TestCSVLoader, SpellPossibilityIteratorTest, RemoteQueryErrorTest, SolrTestCaseJ4Test, DocValuesMultiTest, TestCollationField, SystemInfoHandlerTest, TestSimpleQParserPlugin, CacheHeaderTest, TestStressReorder, ReturnFieldsTest, TestBinaryField, SuggesterFSTTest, TestOverriddenPrefixQueryForCustomFieldType, SearchHandlerTest, SOLR749Test, TestManagedStopFilterFactory, StressHdfsTest, TestFaceting, TestFoldingMultitermQuery, ShardRoutingTest, TestCustomSort, TestHashPartitioner, InfoHandlerTest, ChangedSchemaMergeTest, TestSolrConfigHandlerCloud, TestManagedSchemaFieldTypeResource, UnloadDistributedZkTest, TestJoin, TestConfigOverlay, TestWordDelimiterFilterFactory, CopyFieldTest, TestHighlightDedupGrouping, DocExpirationUpdateProcessorFactoryTest, DisMaxRequestHandlerTest, TestLeaderElectionZkExpiry, AnalysisAfterCoreReloadTest, TestIBSimilarityFactory, MultiTermTest, TestQuerySenderListener, TestLuceneMatchVersion, TestJmxMonitoredMap, TestManagedResource, SpellCheckCollatorTest, VMParamsZkACLAndCredentialsProvidersTest, ShowFileRequestHandlerTest, FileBasedSpellCheckerTest, TestRequestStatusCollectionAPI, TestWriterPerf, SimpleCollectionCreateDeleteTest, TestImplicitCoreProperties, TestNonDefinedSimilarityFactory, TestGroupingSearch, DocumentAnalysisRequestHandlerTest, TestReplicationHandler, ZkSolrClientTest, TestNoOpRegenerator, FacetPivotSmallTest, PeerSyncTest, QueryEqualityTest, TestRTGBase, IndexBasedSpellCheckerTest, CollectionsAPIAsyncDistributedZkTest, QueryResultKeyTest, HdfsDirectoryTest, TestSchemaVersionResource, CSVRequestHandlerTest, StandardRequestHandlerTest, BadComponentTest, TestStandardQParsers, TestManagedSchemaDynamicFieldResource, TestSolrDeletionPolicy2, TestFieldTypeCollectionResource, EchoParamsTest, DirectSolrSpellCheckerTest, TestCloudInspectUtil, IndexSchemaRuntimeFieldTest, TestRestManager, TestZkChroot, TestSchemaSimilarityResource, UUIDFieldTest, AnalysisErrorHandlingTest, BasicDistributedZk2Test, PrimUtilsTest, SignatureUpdateProcessorFactoryTest, BasicZkTest, TestFieldSortValues, LeaderFailoverAfterPartitionTest, DirectUpdateHandlerOptimizeTest, LukeRequestHandlerTest, SuggesterTest, TestMiniSolrCloudCluster, ExitableDirectoryReaderTest, FullSolrCloudDistribCmdsTest, TestChildDocTransformer, TestPartialUpdateDeduplication, SuggestComponentTest, TestRandomFaceting, TestInitParams, HttpPartitionTest, TestSchemaResource, DistributedFacetPivotSmallAdvancedTest, MultiThreadedOCPTest, DateMathParserTest, PingRequestHandlerTest, DeleteReplicaTest, TestPseudoReturnFields, TestFieldTypeResource, DistributedQueryComponentCustomSortTest, TestInfoStreamLogging, TestReRankQParserPlugin, SSLMigrationTest, TestUniqueKeyFieldResource, TestAddFieldRealTimeGet, TestFastLRUCache, TestSolrXml, DebugComponentTest, DocValuesMissingTest, HighlighterTest, TestSolrConfigHandler, ClusterStateTest, LeaderInitiatedRecoveryOnCommitTest, TestNRTOpen, TestCollapseQParserPlugin, SpatialFilterTest, TestRawResponseWriter, ZkNodePropsTest, TestIntervalFaceting, TestExpandComponent, TestCoreContainer, TestRandomMergePolicy, TestReloadAndDeleteDocs, DefaultValueUpdateProcessorTest, TestFreeTextSuggestions, CurrencyFieldOpenExchangeTest, TestShortCircuitedRequests, BinaryUpdateRequestHandlerTest, DateRangeFieldTest, DeleteInactiveReplicaTest, TestDistributedSearch, AlternateDirectoryTest, TestRealTimeGet, ConnectionManagerTest, CoreAdminHandlerTest, HighlighterConfigTest, TermVectorComponentTest, SolrIndexSplitterTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, CollectionsAPIDistributedZkTest, OpenCloseCoreStressTest, OverseerTest, LeaderElectionIntegrationTest, RecoveryZkTest, TestRandomDVFaceting, ShardRoutingCustomTest, AutoCommitTest, TestDistributedGrouping, TestRecovery, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, ZkControllerTest, TestReload, TestStressVersions, HardAutoCommitTest, DistributedTermsComponentTest, TestRangeQuery, SimpleFacetsTest, SolrCoreTest, StatsComponentTest, BadIndexSchemaTest, TestSort, TestFunctionQuery, BasicFunctionalityTest, TestLazyCores, DirectUpdateHandlerTest, TestBadConfig, TestIndexSearcher, SoftAutoCommitTest, DistributedQueryElevationComponentTest, CurrencyFieldXmlFileTest, SimplePostToolTest, TestCoreDiscovery, TestExtendedDismaxParser, DocValuesTest, SuggesterTSTTest, TestStressLucene, TestTrie, SuggesterWFSTTest, PolyFieldTest, WordBreakSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, TestUpdate, FieldMutatingUpdateProcessorTest, TestAtomicUpdateErrorCases, StatelessScriptUpdateProcessorFactoryTest, SortByFunctionTest, TestRemoteStreaming, TestSolrDeletionPolicy1, TestSurroundQueryParser, TestReversedWildcardFilterFactory, TestOmitPositions, TermsComponentTest, XmlUpdateRequestHandlerTest, RequestHandlersTest, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, TestIndexingPerformance, MoreLikeThisHandlerTest, RequiredFieldsTest, FieldAnalysisRequestHandlerTest, TestSolrQueryParser, TestArbitraryIndexDir, LoggingHandlerTest, RegexBoostProcessorTest, SolrPluginUtilsTest, UpdateRequestProcessorFactoryTest, JSONWriterTest, MBeansHandlerTest, QueryParsingTest, TestAnalyzedSuggestions, UniqFieldsUpdateProcessorFactoryTest, JsonLoaderTest, TestPHPSerializedResponseWriter, TestComponentsName, CoreContainerCoreInitFailuresTest, TestBinaryResponseWriter, TestLFUCache, UpdateParamsTest, TestSolrIndexConfig, TestQuerySenderNoQuery, ResponseLogComponentTest, TestStressRecovery, TestMergePolicyConfig, TestDocSet, TestSearchPerf, NumericFieldsTest, MinimalSchemaTest, TestElisionMultitermQuery, TestConfig, OutputWriterTest, TestFuzzyAnalyzedSuggestions, ExternalFileFieldSortTest, TestSolrCoreProperties, TestPostingsSolrHighlighter, DirectSolrConnectionTest, TestPhraseSuggestions, TestCodecSupport, SynonymTokenizerTest, TestXIncludeConfig, TestSweetSpotSimilarityFactory, TestPerFieldSimilarity, TestLMJelinekMercerSimilarityFactory, TestDefaultSimilarityFactory, TestFastWriter, LegacyHTMLStripCharFilterTest, TimeZoneUtilsTest, ResourceLoaderTest, TestFastOutputStream, URLClassifyProcessorTest, PluginInfoTest, ChaosMonkeyNothingIsSafeTest]
[junit4] Completed in 47.92s, 1 test, 1 failure <<< FAILURES!
[...truncated 370 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/build.xml:529: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/build.xml:477: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/build.xml:61: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/extra-targets.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build.xml:190: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/common-build.xml:508: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/lucene/common-build.xml:1363: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/lucene/common-build.xml:970: There were test failures: 453 suites, 1855 tests, 1 failure, 37 ignored (21 assumptions)
Total time: 170 minutes 43 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseG1GC (asserts: false)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any