You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/12/31 10:41:53 UTC
[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.8.0) - Build # 2026
- Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/2026/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC (asserts: true)
1 tests failed.
FAILED: org.apache.solr.cloud.DeleteReplicaTest.testDistribSearch
Error Message:
Should have had a good message here
Stack Trace:
java.lang.AssertionError: Should have had a good message here
at __randomizedtesting.SeedInfo.seed([591894DCBFE2E48:84770755BCA14E74]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:138)
at org.apache.solr.cloud.DeleteReplicaTest.doTest(DeleteReplicaTest.java:89)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
at sun.reflect.GeneratedMethodAccessor112.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 9902 lines...]
[junit4] Suite: org.apache.solr.cloud.DeleteReplicaTest
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/init-core-data-001
[junit4] 2> 3609401 T18675 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
[junit4] 2> 3609401 T18675 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /zlsn/tl
[junit4] 2> 3609405 T18675 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 3609407 T18675 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 3609407 T18676 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 3609509 T18675 oasc.ZkTestServer.run start zk server on port:54483
[junit4] 2> 3609509 T18675 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 3609511 T18675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3609516 T18683 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ee8be72 name:ZooKeeperConnection Watcher:127.0.0.1:54483 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3609516 T18675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3609516 T18675 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 3609517 T18675 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 3609521 T18675 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 3609525 T18675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3609526 T18686 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7a687692 name:ZooKeeperConnection Watcher:127.0.0.1:54483/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3609527 T18675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3609527 T18675 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 3609527 T18675 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 3609532 T18675 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 3609536 T18675 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 3609539 T18675 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 3609544 T18675 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 3609545 T18675 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 3609551 T18675 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 3609552 T18675 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 3609558 T18675 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 3609559 T18675 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 3609566 T18675 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 3609567 T18675 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 3609571 T18675 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 3609573 T18675 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 3609578 T18675 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 3609579 T18675 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 3609583 T18675 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 3609585 T18675 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 3609590 T18675 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 3609591 T18675 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 3609596 T18675 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 3609599 T18675 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 3609603 T18675 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 3609605 T18675 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 3609618 T18675 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 3609620 T18675 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 3611690 T18675 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 3611694 T18675 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54486
[junit4] 2> 3611695 T18675 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
[junit4] 2> 3611696 T18675 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 3611697 T18675 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-002
[junit4] 2> 3611697 T18675 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-002/'
[junit4] 2> 3611742 T18675 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-002/solr.xml
[junit4] 2> 3611755 T18675 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-002
[junit4] 2> 3611757 T18675 oasc.CoreContainer.<init> New CoreContainer 557114517
[junit4] 2> 3611757 T18675 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-002/]
[junit4] 2> 3611757 T18675 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 3611758 T18675 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 3611758 T18675 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 3611759 T18675 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 3611759 T18675 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 3611760 T18675 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 3611760 T18675 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 3611760 T18675 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 3611761 T18675 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 3611761 T18675 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 3611761 T18675 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 3611762 T18675 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 3611763 T18675 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 3611763 T18675 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 3611763 T18675 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54483/solr
[junit4] 2> 3611763 T18675 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 3611764 T18675 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 3611767 T18675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3611770 T18698 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@54639cfe name:ZooKeeperConnection Watcher:127.0.0.1:54483 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3611770 T18675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3611771 T18675 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 3611775 T18675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3611779 T18701 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4cea4b5f name:ZooKeeperConnection Watcher:127.0.0.1:54483/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3611779 T18675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3611781 T18675 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 3611786 T18675 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 3611792 T18675 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 3611797 T18675 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 3611803 T18675 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 3611810 T18675 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 3611812 T18675 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54486_zlsn%2Ftl
[junit4] 2> 3611813 T18675 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54486_zlsn%2Ftl
[junit4] 2> 3611819 T18675 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 3611823 T18675 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 3611827 T18675 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 3611830 T18675 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:54486_zlsn%2Ftl
[junit4] 2> 3611831 T18675 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 3611836 T18675 oasc.Overseer.start Overseer (id=93062279465074691-127.0.0.1:54486_zlsn%2Ftl-n_0000000000) starting
[junit4] 2> 3611841 T18675 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 3611865 T18675 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 3611868 T18703 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 3611875 T18702 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 3611885 T18675 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 3611889 T18675 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 3611892 T18675 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 3611902 T18675 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-002
[junit4] 2> 3612525 T18675 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-002/conf/
[junit4] 2> 3612625 T18675 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 3612627 T18675 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 3612627 T18675 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 3612628 T18675 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 3612630 T18675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3612633 T18708 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34bf8302 name:ZooKeeperConnection Watcher:127.0.0.1:54483/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3612633 T18675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3612634 T18675 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 3612638 T18675 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 3612647 T18675 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 3612647 T18675 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
[junit4] 2> 3612648 T18675 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 3612649 T18675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3612652 T18711 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3814d0e7 name:ZooKeeperConnection Watcher:127.0.0.1:54483/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3612652 T18675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3612652 T18675 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 3612655 T18701 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 3612675 T18702 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 0, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":2} current state version: 0
[junit4] 2> 3612675 T18702 oasco.ClusterStateMutator.createCollection building a new cName: collection1
[junit4] 2> 3612678 T18702 oasco.ZkStateWriter.writePendingUpdates going to create_collection /collections/collection1/state.json
[junit4] 2> 3612682 T18708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3612682 T18701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3614415 T18675 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 3614416 T18675 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 3614420 T18675 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54491
[junit4] 2> 3614421 T18675 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
[junit4] 2> 3614422 T18675 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 3614422 T18675 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-003
[junit4] 2> 3614422 T18675 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-003/'
[junit4] 2> 3614461 T18675 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-003/solr.xml
[junit4] 2> 3614471 T18675 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-003
[junit4] 2> 3614474 T18675 oasc.CoreContainer.<init> New CoreContainer 668436460
[junit4] 2> 3614474 T18675 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-003/]
[junit4] 2> 3614475 T18675 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 3614475 T18675 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 3614475 T18675 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 3614476 T18675 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 3614476 T18675 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 3614477 T18675 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 3614477 T18675 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 3614477 T18675 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 3614477 T18675 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 3614478 T18675 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 3614479 T18675 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 3614479 T18675 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 3614479 T18675 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 3614480 T18675 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 3614481 T18675 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54483/solr
[junit4] 2> 3614481 T18675 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 3614482 T18675 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 3614483 T18675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3614485 T18723 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4bef7015 name:ZooKeeperConnection Watcher:127.0.0.1:54483 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3614487 T18675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3614487 T18675 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 3614500 T18675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3614501 T18726 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@638a7a95 name:ZooKeeperConnection Watcher:127.0.0.1:54483/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3614502 T18675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3614518 T18675 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 3615531 T18675 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54491_zlsn%2Ftl
[junit4] 2> 3615533 T18675 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54491_zlsn%2Ftl
[junit4] 2> 3615543 T18675 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 3615547 T18675 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-003
[junit4] 2> 3616178 T18675 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-003/conf/
[junit4] 2> 3616272 T18675 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 3616275 T18675 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 3616275 T18675 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 3618083 T18675 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 3618083 T18675 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 3618089 T18675 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54494
[junit4] 2> 3618090 T18675 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
[junit4] 2> 3618091 T18675 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 3618091 T18675 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-004
[junit4] 2> 3618092 T18675 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-004/'
[junit4] 2> 3618134 T18675 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-004/solr.xml
[junit4] 2> 3618149 T18675 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-004
[junit4] 2> 3618151 T18675 oasc.CoreContainer.<init> New CoreContainer 701153687
[junit4] 2> 3618151 T18675 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-004/]
[junit4] 2> 3618152 T18675 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 3618153 T18675 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 3618153 T18675 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 3618154 T18675 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 3618154 T18675 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 3618154 T18675 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 3618155 T18675 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 3618156 T18675 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 3618156 T18675 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 3618156 T18675 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 3618157 T18675 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 3618157 T18675 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 3618158 T18675 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 3618158 T18675 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 3618159 T18675 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54483/solr
[junit4] 2> 3618159 T18675 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 3618160 T18675 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 3618162 T18675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3618164 T18739 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5198081f name:ZooKeeperConnection Watcher:127.0.0.1:54483 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3618164 T18675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3618165 T18675 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 3618172 T18675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3618175 T18742 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70816eb1 name:ZooKeeperConnection Watcher:127.0.0.1:54483/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3618175 T18675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3618196 T18675 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 3619211 T18675 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54494_zlsn%2Ftl
[junit4] 2> 3619212 T18675 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54494_zlsn%2Ftl
[junit4] 2> 3619224 T18675 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 3619229 T18675 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-004
[junit4] 2> 3619900 T18675 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-004/conf/
[junit4] 2> 3619992 T18675 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 3619994 T18675 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 3619994 T18675 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 3621939 T18675 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 3621941 T18675 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 3621947 T18675 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54497
[junit4] 2> 3621947 T18675 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
[junit4] 2> 3621949 T18675 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 3621949 T18675 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-005
[junit4] 2> 3621952 T18675 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-005/'
[junit4] 2> 3621994 T18675 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-005/solr.xml
[junit4] 2> 3622008 T18675 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-005
[junit4] 2> 3622010 T18675 oasc.CoreContainer.<init> New CoreContainer 1119529826
[junit4] 2> 3622010 T18675 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-005/]
[junit4] 2> 3622011 T18675 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 3622011 T18675 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 3622012 T18675 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 3622012 T18675 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 3622012 T18675 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 3622012 T18675 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 3622013 T18675 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 3622014 T18675 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 3622014 T18675 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 3622014 T18675 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 3622014 T18675 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 3622015 T18675 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 3622016 T18675 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 3622016 T18675 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 3622017 T18675 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54483/solr
[junit4] 2> 3622017 T18675 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 3622018 T18675 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 3622021 T18675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3622022 T18755 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32ba09f8 name:ZooKeeperConnection Watcher:127.0.0.1:54483 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3622023 T18675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3622024 T18675 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 3622032 T18675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3622035 T18758 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@785074b2 name:ZooKeeperConnection Watcher:127.0.0.1:54483/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3622035 T18675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3622060 T18675 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 3623073 T18675 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54497_zlsn%2Ftl
[junit4] 2> 3623075 T18675 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54497_zlsn%2Ftl
[junit4] 2> 3623086 T18675 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 3623093 T18675 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-005
[junit4] 2> 3623743 T18675 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-005/conf/
[junit4] 2> 3623835 T18675 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 3623837 T18675 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 3623838 T18675 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 3625649 T18675 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
[junit4] 2> 3625650 T18675 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 3625655 T18675 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54500
[junit4] 2> 3625657 T18675 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
[junit4] 2> 3625657 T18675 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 3625657 T18675 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-006
[junit4] 2> 3625658 T18675 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-006/'
[junit4] 2> 3625700 T18675 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-006/solr.xml
[junit4] 2> 3625714 T18675 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-006
[junit4] 2> 3625717 T18675 oasc.CoreContainer.<init> New CoreContainer 2039794306
[junit4] 2> 3625717 T18675 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-006/]
[junit4] 2> 3625719 T18675 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 3625719 T18675 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 3625719 T18675 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 3625720 T18675 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 3625721 T18675 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 3625721 T18675 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 3625721 T18675 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 3625721 T18675 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 3625722 T18675 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 3625722 T18675 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 3625722 T18675 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 3625723 T18675 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 3625724 T18675 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 3625724 T18675 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 3625725 T18675 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54483/solr
[junit4] 2> 3625725 T18675 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 3625725 T18675 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 3625728 T18675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3625731 T18771 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@21ceb616 name:ZooKeeperConnection Watcher:127.0.0.1:54483 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3625731 T18675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3625732 T18675 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 3625740 T18675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3625744 T18774 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@329281d3 name:ZooKeeperConnection Watcher:127.0.0.1:54483/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3625744 T18675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3625763 T18675 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 3626777 T18675 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54500_zlsn%2Ftl
[junit4] 2> 3626779 T18675 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54500_zlsn%2Ftl
[junit4] 2> 3626789 T18675 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 3626794 T18675 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-006
[junit4] 2> 3627573 T18675 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-006/conf/
[junit4] 2> 3627731 T18675 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 3627732 T18675 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 3627733 T18675 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 3627739 T18675 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 3627759 T18675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3627766 T18778 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d062add name:ZooKeeperConnection Watcher:127.0.0.1:54483/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3627766 T18675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3627767 T18675 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 3627770 T18675 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 3627782 T18675 oasc.AbstractFullDistribZkTestBase.createCollection Creating collection with stateFormat=2: delLiveColl
[junit4] 2> 3627782 T18675 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 3627784 T18675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3627796 T18781 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5fd41a0 name:ZooKeeperConnection Watcher:127.0.0.1:54483/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3627797 T18675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3627798 T18675 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 3627800 T18675 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 3627819 T18733 oasha.CollectionsHandler.handleCreateAction Creating Collection : replicationFactor=2&maxShardsPerNode=2&name=delLiveColl&action=CREATE&numShards=2&stateFormat=2&wt=javabin&version=2
[junit4] 2> 3627822 T18701 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/collection-queue-work state SyncConnected
[junit4] 2> 3627828 T18703 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"create",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"delLiveColl",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "stateFormat":"2"}
[junit4] 2> 3627830 T18782 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : create , {
[junit4] 2> "operation":"create",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"delLiveColl",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "stateFormat":"2"}
[junit4] 2> 3627834 T18782 oasc.OverseerCollectionProcessor.createConfNode Only one config set found in zk - using it:conf1
[junit4] 2> 3627835 T18782 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/delLiveColl
[junit4] 2> 3627836 T18782 oascc.SolrZkClient.makePath makePath: /collections/delLiveColl
[junit4] 2> 3627846 T18701 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 3627851 T18702 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"delLiveColl",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "stateFormat":"2"} current state version: 1
[junit4] 2> 3627852 T18702 oasco.ClusterStateMutator.createCollection building a new cName: delLiveColl
[junit4] 2> 3627856 T18702 oasco.ZkStateWriter.writePendingUpdates going to create_collection /collections/delLiveColl/state.json
[junit4] 2> 3627859 T18774 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 3627860 T18708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 3627860 T18726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 3627861 T18742 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 3627860 T18701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 3627862 T18781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 3627860 T18758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 3627865 T18778 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 3628048 T18782 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection delLiveColl, shardNames [shard1, shard2] , replicationFactor : 2
[junit4] 2> 3628049 T18782 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard1_replica1 as part of slice shard1 of collection delLiveColl on 127.0.0.1:54497_zlsn%2Ftl
[junit4] 2> 3628050 T18782 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard1_replica2 as part of slice shard1 of collection delLiveColl on 127.0.0.1:54491_zlsn%2Ftl
[junit4] 2> 3628053 T18782 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard2_replica1 as part of slice shard2 of collection delLiveColl on 127.0.0.1:54486_zlsn%2Ftl
[junit4] 2> 3628054 T18751 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delLiveColl_shard1_replica1&action=CREATE&numShards=2&collection=delLiveColl&shard=shard1&wt=javabin&version=2
[junit4] 2> 3628062 T18716 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delLiveColl_shard1_replica2&action=CREATE&numShards=2&collection=delLiveColl&shard=shard1&wt=javabin&version=2
[junit4] 2> 3628065 T18782 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard2_replica2 as part of slice shard2 of collection delLiveColl on 127.0.0.1:54494_zlsn%2Ftl
[junit4] 2> 3628069 T18693 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delLiveColl_shard2_replica1&action=CREATE&numShards=2&collection=delLiveColl&shard=shard2&wt=javabin&version=2
[junit4] 2> 3628071 T18716 oasc.ZkController.publish publishing core=delLiveColl_shard1_replica2 state=down collection=delLiveColl
[junit4] 2> 3628075 T18736 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delLiveColl_shard2_replica2&action=CREATE&numShards=2&collection=delLiveColl&shard=shard2&wt=javabin&version=2
[junit4] 2> 3628077 T18751 oasc.ZkController.publish publishing core=delLiveColl_shard1_replica1 state=down collection=delLiveColl
[junit4] 2> 3628083 T18736 oasc.ZkController.publish publishing core=delLiveColl_shard2_replica2 state=down collection=delLiveColl
[junit4] 2> 3628083 T18716 oasc.ZkController.preRegister Registering watch for external collection delLiveColl
[junit4] 2> 3628085 T18716 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl
[junit4] 2> 3628084 T18701 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 3628087 T18751 oasc.ZkController.preRegister Registering watch for external collection delLiveColl
[junit4] 2> 3628088 T18751 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl
[junit4] 2> 3628089 T18716 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper...
[junit4] 2> 3628091 T18751 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper...
[junit4] 2> 3628096 T18693 oasc.ZkController.publish publishing core=delLiveColl_shard2_replica1 state=down collection=delLiveColl
[junit4] 2> 3628101 T18716 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 0
[junit4] 2> 3628102 T18716 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 3628102 T18736 oasc.ZkController.preRegister Registering watch for external collection delLiveColl
[junit4] 2> 3628103 T18736 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl
[junit4] 2> 3628103 T18751 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 0
[junit4] 2> 3628105 T18751 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 3628104 T18702 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 2, message = {
[junit4] 2> "core":"delLiveColl_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54491/zlsn/tl",
[junit4] 2> "node_name":"127.0.0.1:54491_zlsn%2Ftl",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 3628106 T18736 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper...
[junit4] 2> 3628109 T18702 oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "core":"delLiveColl_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54491/zlsn/tl",
[junit4] 2> "node_name":"127.0.0.1:54491_zlsn%2Ftl",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "operation":"state"}
[junit4] 2> 3628112 T18736 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 0
[junit4] 2> 3628113 T18736 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 3628115 T18693 oasc.ZkController.preRegister Registering watch for external collection delLiveColl
[junit4] 2> 3628131 T18702 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 3, message = {
[junit4] 2> "core":"delLiveColl_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54497/zlsn/tl",
[junit4] 2> "node_name":"127.0.0.1:54497_zlsn%2Ftl",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 3628132 T18702 oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "core":"delLiveColl_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54497/zlsn/tl",
[junit4] 2> "node_name":"127.0.0.1:54497_zlsn%2Ftl",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "operation":"state"}
[junit4] 2> 3628137 T18701 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 3628141 T18702 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 2, message = {
[junit4] 2> "core":"delLiveColl_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54494/zlsn/tl",
[junit4] 2> "node_name":"127.0.0.1:54494_zlsn%2Ftl",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 3628143 T18702 oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "core":"delLiveColl_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54494/zlsn/tl",
[junit4] 2> "node_name":"127.0.0.1:54494_zlsn%2Ftl",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "operation":"state"}
[junit4] 2> 3628148 T18701 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 3628152 T18702 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core":"delLiveColl_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54486/zlsn/tl",
[junit4] 2> "node_name":"127.0.0.1:54486_zlsn%2Ftl",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 3628153 T18702 oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "core":"delLiveColl_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54486/zlsn/tl",
[junit4] 2> "node_name":"127.0.0.1:54486_zlsn%2Ftl",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "operation":"state"}
[junit4] 2> 3628160 T18701 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 3628164 T18702 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/delLiveColl/state.json version: 0
[junit4] 2> 3628166 T18758 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 3628166 T18726 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 3628167 T18742 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 3628168 T18726 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1
[junit4] 2> 3628169 T18758 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1
[junit4] 2> 3628170 T18742 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1
[junit4] 2> 3628189 T18693 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl
[junit4] 2> 3628191 T18693 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper...
[junit4] 2> 3628197 T18693 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1
[junit4] 2> 3628197 T18693 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 3628197 T18693 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard2_replica1
[junit4] 2> 3628198 T18693 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
[junit4] 2> 3628199 T18693 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 3628199 T18693 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 3628203 T18693 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 3628203 T18693 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-002/delLiveColl_shard2_replica1/'
[junit4] 2> 3628241 T18693 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 3628252 T18693 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 3628274 T18693 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 3628289 T18693 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 3628293 T18693 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 3628297 T18693 oass.IndexSchema.readSchema [delLiveColl_shard2_replica1] Schema name=test
[junit4] 2> 3628434 T18693 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 3628441 T18693 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 3628441 T18693 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 3628485 T18693 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 3628490 T18693 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 3628494 T18693 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 3628496 T18693 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 3628496 T18693 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 3628497 T18693 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 3628498 T18693 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 3628499 T18693 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 3628499 T18693 oasc.CoreContainer.create Creating SolrCore 'delLiveColl_shard2_replica1' using configuration from collection delLiveColl
[junit4] 2> 3628500 T18693 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 3628500 T18693 oasc.SolrCore.<init> [delLiveColl_shard2_replica1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-002/delLiveColl_shard2_replica1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-002/delLiveColl_shard2_replica1/data/
[junit4] 2> 3628500 T18693 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7d96aa1e
[junit4] 2> 3628501 T18693 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-002/delLiveColl_shard2_replica1/data
[junit4] 2> 3628502 T18693 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-002/delLiveColl_shard2_replica1/data/index/
[junit4] 2> 3628502 T18693 oasc.SolrCore.initIndex WARN [delLiveColl_shard2_replica1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-002/delLiveColl_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 3628502 T18693 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-002/delLiveColl_shard2_replica1/data/index
[junit4] 2> 3628503 T18693 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=20, maxMergedSegmentMB=43.58984375, floorSegmentMB=1.443359375, forceMergeDeletesPctAllowed=8.777464663808347, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 3628504 T18693 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@10dbdc4e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@e695720),segFN=segments_1,generation=1}
[junit4] 2> 3628505 T18693 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 3628509 T18693 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 3628509 T18693 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 3628510 T18693 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 3628510 T18693 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 3628511 T18693 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 3628511 T18693 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 3628512 T18693 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 3628513 T18693 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 3628513 T18693 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 3628514 T18693 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 3628515 T18693 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 3628515 T18693 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 3628516 T18693 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 3628516 T18693 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 3628517 T18693 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
[junit4] 2> 3628517 T18693 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 3628517 T18693 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 3628518 T18693 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 3628519 T18693 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 3628520 T18693 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 3628521 T18693 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 3628521 T18693 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 3628522 T18693 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 3628522 T18693 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 3628523 T18693 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 3628523 T18693 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 3628525 T18693 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 3628525 T18693 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 3628534 T18693 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 3628537 T18693 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 3628539 T18693 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 3628540 T18693 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 3628541 T18693 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 3628554 T18693 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 3628555 T18693 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 3628557 T18693 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=19.9052734375, floorSegmentMB=1.4384765625, forceMergeDeletesPctAllowed=22.014005810550188, segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 3628557 T18693 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@10dbdc4e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@e695720),segFN=segments_1,generation=1}
[junit4] 2> 3628558 T18693 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 3628558 T18693 oass.SolrIndexSearcher.<init> Opening Searcher@766da8c3[delLiveColl_shard2_replica1] main
[junit4] 2> 3628559 T18693 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 3628567 T18693 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 3628567 T18693 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 3628568 T18693 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 3628569 T18693 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 3628569 T18693 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3628570 T18693 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 3628570 T18693 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3628570 T18693 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 3628570 T18693 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 3628571 T18787 oasc.SolrCore.registerSearcher [delLiveColl_shard2_replica1] Registered new searcher Searcher@766da8c3[delLiveColl_shard2_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3628571 T18693 oasc.CoreContainer.registerCore registering core: delLiveColl_shard2_replica1
[junit4] 2> 3628572 T18693 oasc.ZkController.register Register replica - core:delLiveColl_shard2_replica1 address:http://127.0.0.1:54486/zlsn/tl collection:delLiveColl shard:shard2
[junit4] 2> 3628574 T18693 oascc.SolrZkClient.makePath makePath: /collections/delLiveColl/leader_elect/shard2/election
[junit4] 2> 3628609 T18693 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 3628624 T18701 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 3628627 T18693 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=179996ms
[junit4] 2> 3628628 T18702 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"delLiveColl"} current state version: 2
[junit4] 2> 3628740 T18702 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/delLiveColl/state.json version: 1
[junit4] 2> 3628743 T18726 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 3628743 T18758 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 3628744 T18742 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 3628745 T18701 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 3628747 T18726 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2
[junit4] 2> 3628747 T18758 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2
[junit4] 2> 3628748 T18742 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2
[junit4] 2> 3628755 T18701 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2
[junit4] 2> 3629103 T18716 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard1_replica2
[junit4] 2> 3629103 T18716 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
[junit4] 2> 3629105 T18716 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 3629105 T18716 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 3629105 T18751 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard1_replica1
[junit4] 2> 3629106 T18751 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
[junit4] 2> 3629107 T18716 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 3629108 T18716 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-003/delLiveColl_shard1_replica2/'
[junit4] 2> 3629108 T18751 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 3629110 T18751 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 3629114 T18736 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard2_replica2
[junit4] 2> 3629114 T18736 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
[junit4] 2> 3629128 T18736 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 3629128 T18736 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 3629133 T18751 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 3629134 T18751 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-005/delLiveColl_shard1_replica1/'
[junit4] 2> 3629135 T18716 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 3629146 T18736 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 3629146 T18736 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-004/delLiveColl_shard2_replica2/'
[junit4] 2> 3629167 T18751 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 3629184 T18736 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 3629190 T18716 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 3629192 T18736 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 3629198 T18751 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 3629215 T18736 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 3629222 T18751 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 3629237 T18751 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 3629240 T18716 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 3629240 T18736 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 3629248 T18751 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 3629270 T18751 oass.IndexSchema.readSchema [delLiveColl_shard1_replica1] Schema name=test
[junit4] 2> 3629272 T18736 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 3629283 T18716 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 3629283 T18736 oass.IndexSchema.readSchema [delLiveColl_shard2_replica2] Schema name=test
[junit4] 2> 3629305 T18716 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 3629310 T18716 oass.IndexSchema.readSchema [delLiveColl_shard1_replica2] Schema name=test
[junit4] 2> 3629534 T18751 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 3629543 T18751 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 3629546 T18751 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 3629566 T18736 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 3629566 T18716 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 3629570 T18736 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 3629572 T18736 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 3629580 T18716 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 3629581 T18716 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 3629627 T18751 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 3629638 T18751 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 3629648 T18751 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 3629659 T18751 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 3629660 T18751 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 3629660 T18751 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 3629665 T18751 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 3629667 T18751 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 3629667 T18751 oasc.CoreContainer.create Creating SolrCore 'delLiveColl_shard1_replica1' using configuration from collection delLiveColl
[junit4] 2> 3629668 T18751 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 3629667 T18716 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 3629670 T18751 oasc.SolrCore.<init> [delLiveColl_shard1_replica1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-005/delLiveColl_shard1_replica1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-005/delLiveColl_shard1_replica1/data/
[junit4] 2> 3629672 T18751 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7d96aa1e
[junit4] 2> 3629672 T18736 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 3629673 T18751 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-005/delLiveColl_shard1_replica1/data
[junit4] 2> 3629674 T18751 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-005/delLiveColl_shard1_replica1/data/index/
[junit4] 2> 3629675 T18751 oasc.SolrCore.initIndex WARN [delLiveColl_shard1_replica1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-005/delLiveColl_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 3629676 T18751 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-591894DCBFE2E48-001/tempDir-005/delLiveColl_shard1_replica1/data/index
[junit4] 2> 3629677 T18751 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=20, maxMergedSegmentMB=43.58984375, floorSegmentMB=1.443359375, forceMergeDeletesPctAllowed=8.777464663808347, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 3629682 T18716 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 3629688 T18736 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 3629689 T18751 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@38153f1a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@40932c4b),segFN=segments_1,generation=1}
[junit4] 2> 3629690 T18751 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 3629694 T18751 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 3629695 T18751 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 3629695 T18751 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 3629696 T18751 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 3629696 T18751 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 3629697 T18751 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 3629699 T18751 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 3629700 T18751 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 3629702 T18751 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 3629703 T18751 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 3629704 T18751 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 3629704 T18751 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 3629705 T18751 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 3629706 T18751 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 3629707 T18751 oasc.RequestHandlers.initHandlersFromConfig created /sche
[...truncated too long message...]
ll tests run in this JVM: [PreAnalyzedUpdateProcessorTest, SolrIndexSplitterTest, TestSolrIndexConfig, TestLMDirichletSimilarityFactory, SuggesterTest, TestIndexingPerformance, CurrencyFieldXmlFileTest, CollectionsAPIDistributedZkTest, TestHighFrequencyDictionaryFactory, TestIndexSearcher, TestCoreDiscovery, DistributedFacetPivotWhiteBoxTest, TestNoOpRegenerator, TestRestManager, TestAddFieldRealTimeGet, TimeZoneUtilsTest, TestSolrConfigHandlerCloud, TestRangeQuery, TestHashPartitioner, DebugComponentTest, TestDynamicFieldResource, QueryParsingTest, TestCursorMarkWithoutUniqueKey, TestCollationFieldDocValues, ModifyConfFileTest, QueryElevationComponentTest, TestNonDefinedSimilarityFactory, TestFastLRUCache, TriLevelCompositeIdRoutingTest, TestLazyCores, EchoParamsTest, PreAnalyzedFieldTest, TestSolr4Spatial, HdfsBasicDistributedZkTest, TestSolrQueryParserResource, OverseerCollectionProcessorTest, TestPhraseSuggestions, SSLMigrationTest, TestManagedSynonymFilterFactory, IndexBasedSpellCheckerTest, TestSchemaSimilarityResource, MoreLikeThisHandlerTest, HdfsWriteToMultipleCollectionsTest, SolrRequestParserTest, ResponseLogComponentTest, TestTrie, TermVectorComponentDistributedTest, TestManagedSchema, HighlighterConfigTest, SearchHandlerTest, IndexSchemaRuntimeFieldTest, TestAnalyzeInfixSuggestions, TestExactSharedStatsCache, TestCloudInspectUtil, TestCloudPivotFacet, OverriddenZkACLAndCredentialsProvidersTest, UpdateParamsTest, TestClusterStateMutator, DistributedQueueTest, TestUtils, DistributedQueryComponentCustomSortTest, FileUtilsTest, TestRecovery, TestSolrQueryParserDefaultOperatorResource, SolrPluginUtilsTest, StatelessScriptUpdateProcessorFactoryTest, TestLMJelinekMercerSimilarityFactory, TestReplicationHandlerBackup, SpellCheckComponentTest, TestCoreContainer, DistributedTermsComponentTest, BasicFunctionalityTest, TestAnalyzedSuggestions, OverseerTest, TestManagedSchemaFieldResource, UniqFieldsUpdateProcessorFactoryTest, TestValueSourceCache, TestRecoveryHdfs, TestSurroundQueryParser, ExternalFileFieldSortTest, CurrencyFieldOpenExchangeTest, TestCharFilters, TestCollationField, TestCSVResponseWriter, TestFieldCollectionResource, TestBlobHandler, SuggesterFSTTest, DistributedFacetPivotLongTailTest, TestRealTimeGet, InfoHandlerTest, TestConfig, UUIDUpdateProcessorFallbackTest, DeleteInactiveReplicaTest, DistributedSpellCheckComponentTest, HdfsUnloadDistributedZkTest, JsonLoaderTest, TestManagedSchemaFieldTypeResource, TestSolrConfigHandlerConcurrent, TestReloadAndDeleteDocs, SuggesterTSTTest, TestRandomMergePolicy, HdfsSyncSliceTest, TestExceedMaxTermLength, TestPivotHelperCode, ShardRoutingCustomTest, TestFieldTypeCollectionResource, CloudMLTQParserTest, TestDefaultSearchFieldResource, TestSimpleQParserPlugin, StressHdfsTest, TestAtomicUpdateErrorCases, TestBM25SimilarityFactory, RequiredFieldsTest, TestInfoStreamLogging, TestPerFieldSimilarity, TestZkChroot, TestDistribDocBasedVersion, HdfsChaosMonkeySafeLeaderTest, RequestHandlersTest, TestLFUCache, TestPartialUpdateDeduplication, TestDefaultStatsCache, TestSolrXmlPersistence, SolrCmdDistributorTest, TestCodecSupport, TestSuggestSpellingConverter, ReturnFieldsTest, TestManagedStopFilterFactory, SortByFunctionTest, AnalyticsQueryTest, BadComponentTest, CursorPagingTest, TestInitQParser, TestArbitraryIndexDir, ReplicationFactorTest, SpellingQueryConverterTest, DistribCursorPagingTest, TestBulkSchemaConcurrent, TestBadConfig, CSVRequestHandlerTest, ResourceLoaderTest, PeerSyncTest, TestCloudManagedSchemaConcurrent, SolrIndexConfigTest, TestConfigReload, TestQuerySenderListener, LeaderFailoverAfterPartitionTest, NotRequiredUniqueKeyTest, AtomicUpdatesTest, TestNonNRTOpen, FieldMutatingUpdateProcessorTest, TestSchemaVersionResource, TestTolerantSearch, CoreAdminHandlerTest, LukeRequestHandlerTest, QueryEqualityTest, FieldAnalysisRequestHandlerTest, RollingRestartTest, MigrateRouteKeyTest, TestClassNameShortening, TestSolrXmlPersistor, TestWriterPerf, PingRequestHandlerTest, TestFiltering, DocExpirationUpdateProcessorFactoryTest, HighlighterMaxOffsetTest, TestCloudManagedSchema, TestSolrDynamicMBean, TestSolrJ, ConnectionManagerTest, SolrCoreTest, ChangedSchemaMergeTest, TestRebalanceLeaders, RankQueryTest, ClusterStateUpdateTest, TestDistributedGrouping, DistributedQueryComponentOptimizationTest, AddSchemaFieldsUpdateProcessorFactoryTest, HdfsCollectionsAPIDistributedZkTest, SolrCoreCheckLockOnStartupTest, SuggestComponentTest, DirectUpdateHandlerOptimizeTest, TestManagedResourceStorage, CoreMergeIndexesAdminHandlerTest, PluginInfoTest, TestBinaryResponseWriter, TestHighlightDedupGrouping, AnalyticsMergeStrategyTest, TestExpandComponent, ChaosMonkeySafeLeaderTest, BJQParserTest, PolyFieldTest, ZkSolrClientTest, OpenExchangeRatesOrgProviderTest, TestDocumentBuilder, UnloadDistributedZkTest, HdfsDirectoryTest, TestPseudoReturnFields, TestReplicaProperties, TestRequestStatusCollectionAPI, TestDocBasedVersionConstraints, FastVectorHighlighterTest, DistribDocExpirationUpdateProcessorTest, DistributedFacetPivotLargeTest, MinimalSchemaTest, LeaderElectionTest, CoreAdminRequestStatusTest, DistributedFacetPivotSmallAdvancedTest, TestFastOutputStream, TestElisionMultitermQuery, TestShardHandlerFactory, WordBreakSolrSpellCheckerTest, DirectUpdateHandlerTest, BadCopyFieldTest, TestRandomDVFaceting, TestMissingGroups, TestLRUStatsCache, ExitableDirectoryReaderTest, DistributedFacetPivotSmallTest, XsltUpdateRequestHandlerTest, TestDistributedSearch, DeleteShardTest, DistanceFunctionTest, NumericFieldsTest, BasicDistributedZkTest, BasicDistributedZk2Test, SyncSliceTest, OpenCloseCoreStressTest, LeaderElectionIntegrationTest, ShardRoutingTest, BasicZkTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest, TestReplicationHandler, TestRandomFaceting, ZkCLITest, AutoCommitTest, TestFaceting, ZkControllerTest, TestStressReorder, TestJoin, TestReload, TestStressVersions, HardAutoCommitTest, SimpleFacetsTest, StatsComponentTest, TestGroupingSearch, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestFunctionQuery, HighlighterTest, SoftAutoCommitTest, ShowFileRequestHandlerTest, DistributedQueryElevationComponentTest, SimplePostToolTest, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, SpellCheckCollatorTest, TestFoldingMultitermQuery, DocValuesTest, TestStressLucene, SpatialFilterTest, SuggesterWFSTTest, TestCSVLoader, NoCacheHeaderTest, SchemaVersionSpecificBehaviorTest, TestUpdate, TestWordDelimiterFilterFactory, DefaultValueUpdateProcessorTest, TestRemoteStreaming, DocValuesMultiTest, TestSolrDeletionPolicy1, SolrInfoMBeanTest, CacheHeaderTest, DisMaxRequestHandlerTest, TestQueryUtils, StandardRequestHandlerTest, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, DocumentAnalysisRequestHandlerTest, TestQueryTypes, PrimitiveFieldTypeTest, TestOmitPositions, FileBasedSpellCheckerTest, TermsComponentTest, XmlUpdateRequestHandlerTest, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, TermVectorComponentTest, TestSolrQueryParser, LoggingHandlerTest, RegexBoostProcessorTest, IndexSchemaTest, TestJmxIntegration, UpdateRequestProcessorFactoryTest, JSONWriterTest, MBeansHandlerTest, BinaryUpdateRequestHandlerTest, TestPHPSerializedResponseWriter, TestComponentsName, CoreContainerCoreInitFailuresTest, SOLR749Test, AlternateDirectoryTest, TestQuerySenderNoQuery, CopyFieldTest, TestStressRecovery, TestMergePolicyConfig, TestSolrDeletionPolicy2, MultiTermTest, SampleTest, TestDocSet, TestBinaryField, TestSearchPerf, OutputWriterTest, TestFuzzyAnalyzedSuggestions, TestSolrCoreProperties, TestPostingsSolrHighlighter, DirectSolrConnectionTest, TestLuceneMatchVersion, SpellPossibilityIteratorTest, SynonymTokenizerTest, TestXIncludeConfig, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestIBSimilarityFactory, TestDefaultSimilarityFactory, TestFastWriter, LegacyHTMLStripCharFilterTest, TestJmxMonitoredMap, ScriptEngineTest, URLClassifyProcessorTest, DateMathParserTest, ChaosMonkeyNothingIsSafeTest, TestSystemIdResolver, PrimUtilsTest, DateFieldTest, DOMUtilTest, RAMDirectoryFactoryTest, ClusterStateTest, TestLRUCache, ZkNodePropsTest, SliceStateTest, SystemInfoHandlerTest, UUIDFieldTest, CircularListTest, TestRTGBase, DistributedIntervalFacetingTest, SolrTestCaseJ4Test, TestDistributedMissingSort, AliasIntegrationTest, AssignTest, AsyncMigrateRouteKeyTest, CloudExitableDirectoryReaderTest, CollectionsAPIAsyncDistributedZkTest, CustomCollectionTest, DeleteReplicaTest]
[junit4] Completed in 33.21s, 1 test, 1 failure <<< FAILURES!
[...truncated 269 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:519: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:467: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:61: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:187: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:510: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1349: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:956: There were test failures: 459 suites, 1856 tests, 1 failure, 37 ignored (21 assumptions)
Total time: 112 minutes 48 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC (asserts: true)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.8.0) - Build # 2028
- Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/2028/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseG1GC (asserts: true)
2 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([ACA3BF961C3082C4]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([ACA3BF961C3082C4]:0)
Build Log:
[...truncated 9425 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/init-core-data-001
[junit4] 2> 2915835 T14355 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
[junit4] 2> 2915836 T14355 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 2915852 T14355 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 2915853 T14355 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2915855 T14356 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2915956 T14355 oasc.ZkTestServer.run start zk server on port:53946
[junit4] 2> 2915957 T14355 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2915958 T14355 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2915965 T14363 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@52e17cd5 name:ZooKeeperConnection Watcher:127.0.0.1:53946 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2915966 T14355 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2915967 T14355 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2915967 T14355 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2915993 T14355 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2915995 T14355 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2916002 T14366 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4bb87f7f name:ZooKeeperConnection Watcher:127.0.0.1:53946/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2916003 T14355 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2916003 T14355 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2916004 T14355 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 2916019 T14355 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 2916030 T14355 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 2916041 T14355 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 2916052 T14355 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2916054 T14355 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 2916068 T14355 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 2916069 T14355 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 2916079 T14355 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2916080 T14355 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2916090 T14355 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2916092 T14355 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 2916101 T14355 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2916103 T14355 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 2916112 T14355 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2916112 T14355 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 2916119 T14355 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 2916120 T14355 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 2916135 T14355 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2916136 T14355 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 2916146 T14355 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2916147 T14355 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2916156 T14355 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2916157 T14355 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 2916169 T14355 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2916170 T14355 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 2918430 T14355 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2918439 T14355 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53949
[junit4] 2> 2918441 T14355 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
[junit4] 2> 2918442 T14355 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2918443 T14355 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-002
[junit4] 2> 2918444 T14355 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-002/'
[junit4] 2> 2918503 T14355 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-002/solr.xml
[junit4] 2> 2918524 T14355 oasc.CoreContainer.<init> New CoreContainer 1170164933
[junit4] 2> 2918525 T14355 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-002/]
[junit4] 2> 2918525 T14355 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2918527 T14355 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2918527 T14355 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2918527 T14355 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2918528 T14355 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 2918529 T14355 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2918529 T14355 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2918529 T14355 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2918530 T14355 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2918530 T14355 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2918531 T14355 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2918532 T14355 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2918533 T14355 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2918533 T14355 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2918534 T14355 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53946/solr
[junit4] 2> 2918534 T14355 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2918534 T14355 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2918536 T14355 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2918539 T14378 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ed58da8 name:ZooKeeperConnection Watcher:127.0.0.1:53946 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2918539 T14355 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2918540 T14355 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2918545 T14355 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2918549 T14381 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3b336c6a name:ZooKeeperConnection Watcher:127.0.0.1:53946/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2918549 T14355 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2918553 T14355 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2918564 T14355 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2918573 T14355 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 2918584 T14355 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 2918593 T14355 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 2918602 T14355 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2918607 T14355 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53949_
[junit4] 2> 2918610 T14355 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53949_
[junit4] 2> 2918619 T14355 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2918625 T14355 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2918631 T14355 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2918638 T14355 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:53949_
[junit4] 2> 2918638 T14355 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2918645 T14355 oasc.Overseer.start Overseer (id=93067262210670595-127.0.0.1:53949_-n_0000000000) starting
[junit4] 2> 2918652 T14355 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2918682 T14355 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 2918684 T14383 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2918685 T14355 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2918693 T14355 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2918700 T14355 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2918715 T14382 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2918722 T14385 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 2918723 T14385 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2918725 T14381 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2918733 T14385 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2918735 T14382 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 0, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:53949",
[junit4] 2> "node_name":"127.0.0.1:53949_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 2918737 T14382 oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:53949",
[junit4] 2> "node_name":"127.0.0.1:53949_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 2918738 T14382 oasco.ClusterStateMutator.createCollection building a new cName: control_collection
[junit4] 2> 2918738 T14382 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2918742 T14381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2919734 T14385 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2919735 T14385 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 2919737 T14385 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2919738 T14385 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 2919743 T14385 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2919744 T14385 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-002/collection1/'
[junit4] 2> 2919745 T14385 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 2919746 T14385 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 2919747 T14385 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 2919785 T14385 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 2919791 T14385 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 2919803 T14385 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 2919807 T14385 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2919818 T14385 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2919821 T14385 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 2919827 T14385 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2919963 T14385 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2919965 T14385 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2919965 T14385 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2919971 T14385 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2920022 T14385 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 2920022 T14385 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 2920022 T14385 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-002/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/control/data/
[junit4] 2> 2920023 T14385 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8ad79f4
[junit4] 2> 2920025 T14385 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/control/data
[junit4] 2> 2920025 T14385 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/control/data/index/
[junit4] 2> 2920026 T14385 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 2920027 T14385 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/control/data/index
[junit4] 2> 2920027 T14385 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=87.568359375, floorSegmentMB=1.501953125, forceMergeDeletesPctAllowed=27.55218996331614, segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8881378966558299
[junit4] 2> 2920030 T14385 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 2920030 T14385 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2920040 T14385 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2920041 T14385 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2920042 T14385 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2920043 T14385 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2920043 T14385 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2920043 T14385 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2920044 T14385 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2920045 T14385 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2920045 T14385 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2920046 T14385 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2920047 T14385 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2920047 T14385 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2920047 T14385 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2920048 T14385 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 2920048 T14385 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
[junit4] 2> 2920049 T14385 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 2920049 T14385 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 2920050 T14385 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 2920051 T14385 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 2920051 T14385 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 2920053 T14385 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 2920053 T14385 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 2920054 T14385 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 2920054 T14385 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 2920055 T14385 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 2920055 T14385 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2920056 T14385 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2920057 T14385 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2920064 T14385 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2920066 T14385 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2920067 T14385 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2920068 T14385 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2920069 T14385 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 2920071 T14385 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2920071 T14385 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2920072 T14385 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=47.3642578125, floorSegmentMB=0.8271484375, forceMergeDeletesPctAllowed=23.156128234359365, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 2920075 T14385 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 2920075 T14385 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2920075 T14385 oass.SolrIndexSearcher.<init> Opening Searcher@6c5a0de0[collection1] main
[junit4] 2> 2920078 T14385 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 2920082 T14385 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2920082 T14385 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2920083 T14385 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2920084 T14385 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 2920084 T14385 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2920086 T14385 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 2920086 T14385 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2920086 T14385 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 2920086 T14385 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2920087 T14385 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2920088 T14386 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6c5a0de0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2920088 T14389 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53949 collection:control_collection shard:shard1
[junit4] 2> 2920089 T14355 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2920090 T14355 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2920091 T14355 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2920092 T14389 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 2920093 T14355 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2920097 T14392 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@22de1753 name:ZooKeeperConnection Watcher:127.0.0.1:53946/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2920098 T14355 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2920098 T14355 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2920101 T14355 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2920107 T14389 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 2920110 T14355 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 2920111 T14355 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
[junit4] 2> 2920111 T14355 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2920112 T14381 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2920114 T14355 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2920117 T14389 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2920117 T14389 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C3653 name=collection1 org.apache.solr.core.SolrCore@401a060f url=http://127.0.0.1:53949/collection1 node=127.0.0.1:53949_ C3653_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=http://127.0.0.1:53949, node_name=127.0.0.1:53949_, state=down}
[junit4] 2> 2920117 T14389 C3653 P53949 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53949/collection1/
[junit4] 2> 2920118 T14389 C3653 P53949 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2920119 T14389 C3653 P53949 oasc.SyncStrategy.syncToMe http://127.0.0.1:53949/collection1/ has no replicas
[junit4] 2> 2920119 T14389 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53949/collection1/ shard1
[junit4] 2> 2920118 T14382 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 2920120 T14389 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 2920119 T14395 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76d3574e name:ZooKeeperConnection Watcher:127.0.0.1:53946/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2920122 T14355 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2920123 T14355 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2920133 T14382 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "stateFormat":2} current state version: 1
[junit4] 2> 2920134 T14382 oasco.ClusterStateMutator.createCollection building a new cName: collection1
[junit4] 2> 2920136 T14392 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2920140 T14381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2920166 T14396 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2920193 T14382 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:53949",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 2
[junit4] 2> 2920194 T14382 oasco.ZkStateWriter.writePendingUpdates going to create_collection /collections/collection1/state.json
[junit4] 2> 2920198 T14392 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2920215 T14396 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2920219 T14392 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2920286 T14389 oasc.ZkController.register We are http://127.0.0.1:53949/collection1/ and leader is http://127.0.0.1:53949/collection1/
[junit4] 2> 2920288 T14389 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53949
[junit4] 2> 2920288 T14389 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2920288 T14389 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 2920288 T14389 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2920291 T14381 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2920293 T14382 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:53949",
[junit4] 2> "node_name":"127.0.0.1:53949_",
[junit4] 2> "numShards":"3",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 4
[junit4] 2> 2920294 T14382 oasco.ReplicaMutator.updateState Update state numShards=3 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:53949",
[junit4] 2> "node_name":"127.0.0.1:53949_",
[junit4] 2> "numShards":"3",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 2920404 T14381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2920405 T14392 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2921809 T14355 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 2921810 T14355 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2921816 T14355 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53954
[junit4] 2> 2921818 T14355 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
[junit4] 2> 2921819 T14355 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2921819 T14355 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-003
[junit4] 2> 2921819 T14355 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-003/'
[junit4] 2> 2921874 T14355 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-003/solr.xml
[junit4] 2> 2921925 T14355 oasc.CoreContainer.<init> New CoreContainer 850377707
[junit4] 2> 2921926 T14355 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-003/]
[junit4] 2> 2921927 T14355 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2921928 T14355 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2921928 T14355 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2921929 T14355 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2921929 T14355 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 2921930 T14355 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2921931 T14355 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2921931 T14355 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2921932 T14355 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2921932 T14355 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2921933 T14355 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2921934 T14355 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2921934 T14355 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2921935 T14355 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2921936 T14355 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53946/solr
[junit4] 2> 2921937 T14355 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2921938 T14355 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2921939 T14355 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2921944 T14408 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4167548d name:ZooKeeperConnection Watcher:127.0.0.1:53946 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2921944 T14355 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2921945 T14355 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2921950 T14355 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2921954 T14411 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70150838 name:ZooKeeperConnection Watcher:127.0.0.1:53946/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2921954 T14355 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2921973 T14355 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2922992 T14355 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53954_
[junit4] 2> 2922994 T14355 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53954_
[junit4] 2> 2923005 T14355 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2923022 T14412 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 2923022 T14412 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2923026 T14381 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2923029 T14412 oasc.ZkController.preRegister Registering watch for external collection collection1
[junit4] 2> 2923029 T14412 oascc.ZkStateReader.addZkWatch addZkWatch collection1
[junit4] 2> 2923029 T14382 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:53954",
[junit4] 2> "node_name":"127.0.0.1:53954_",
[junit4] 2> "numShards":"3",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 5
[junit4] 2> 2923031 T14412 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper...
[junit4] 2> 2923031 T14382 oasco.ReplicaMutator.updateState Update state numShards=3 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:53954",
[junit4] 2> "node_name":"127.0.0.1:53954_",
[junit4] 2> "numShards":"3",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 2923032 T14382 oasco.ReplicaMutator.updateState Collection already exists with numShards=3
[junit4] 2> 2923033 T14382 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard2
[junit4] 2> 2923035 T14412 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 0
[junit4] 2> 2923035 T14412 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2923036 T14382 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 0
[junit4] 2> 2923038 T14411 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2923039 T14411 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 1
[junit4] 2> 2924036 T14412 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2924037 T14412 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 2924039 T14412 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2924040 T14412 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2924046 T14412 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2924046 T14412 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-003/collection1/'
[junit4] 2> 2924048 T14412 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 2924051 T14412 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 2924051 T14412 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 2924121 T14412 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 2924129 T14412 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 2924148 T14412 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 2924154 T14412 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2924165 T14412 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2924168 T14412 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 2924174 T14412 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2924294 T14412 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2924297 T14412 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2924299 T14412 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2924314 T14412 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2924392 T14412 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 2924393 T14412 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 2924393 T14412 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-003/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/jetty1/
[junit4] 2> 2924393 T14412 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8ad79f4
[junit4] 2> 2924394 T14412 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/jetty1
[junit4] 2> 2924395 T14412 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/jetty1/index/
[junit4] 2> 2924396 T14412 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 2924396 T14412 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/jetty1/index
[junit4] 2> 2924397 T14412 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=87.568359375, floorSegmentMB=1.501953125, forceMergeDeletesPctAllowed=27.55218996331614, segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8881378966558299
[junit4] 2> 2924401 T14412 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 2924401 T14412 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2924408 T14412 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2924409 T14412 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2924410 T14412 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2924410 T14412 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2924411 T14412 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2924411 T14412 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2924412 T14412 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2924413 T14412 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2924413 T14412 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2924414 T14412 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2924414 T14412 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2924414 T14412 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2924415 T14412 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2924416 T14412 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 2924416 T14412 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
[junit4] 2> 2924418 T14412 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 2924419 T14412 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 2924420 T14412 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 2924425 T14412 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 2924430 T14412 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 2924431 T14412 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 2924432 T14412 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 2924433 T14412 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 2924434 T14412 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 2924435 T14412 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 2924436 T14412 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2924436 T14412 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2924437 T14412 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2924449 T14412 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2924454 T14412 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2924455 T14412 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2924456 T14412 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2924456 T14412 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 2924459 T14412 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2924460 T14412 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2924460 T14412 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=47.3642578125, floorSegmentMB=0.8271484375, forceMergeDeletesPctAllowed=23.156128234359365, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 2924461 T14412 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 2924462 T14412 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2924462 T14412 oass.SolrIndexSearcher.<init> Opening Searcher@ea45e9[collection1] main
[junit4] 2> 2924462 T14412 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2924465 T14412 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2924465 T14412 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2924467 T14412 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2924467 T14412 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 2924467 T14412 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2924469 T14412 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 2924469 T14412 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2924469 T14412 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 2924471 T14412 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2924472 T14413 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ea45e9[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2924473 T14412 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2924475 T14416 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53954 collection:collection1 shard:shard2
[junit4] 2> 2924477 T14355 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2924478 T14355 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2924479 T14416 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 2924499 T14416 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 2924505 T14416 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2924506 T14416 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C3654 name=collection1 org.apache.solr.core.SolrCore@21720329 url=http://127.0.0.1:53954/collection1 node=127.0.0.1:53954_ C3654_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:53954, node_name=127.0.0.1:53954_, state=down}
[junit4] 2> 2924506 T14416 C3654 P53954 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53954/collection1/
[junit4] 2> 2924507 T14416 C3654 P53954 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2924508 T14416 C3654 P53954 oasc.SyncStrategy.syncToMe http://127.0.0.1:53954/collection1/ has no replicas
[junit4] 2> 2924509 T14416 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53954/collection1/ shard2
[junit4] 2> 2924509 T14416 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 2924508 T14381 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2924513 T14382 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1"} current state version: 5
[junit4] 2> 2924518 T14382 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 1
[junit4] 2> 2924523 T14411 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2924533 T14411 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 2
[junit4] 2> 2924567 T14381 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2924573 T14382 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:53954",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 5
[junit4] 2> 2924577 T14382 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 2
[junit4] 2> 2924580 T14411 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2924585 T14411 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3
[junit4] 2> 2924623 T14416 oasc.ZkController.register We are http://127.0.0.1:53954/collection1/ and leader is http://127.0.0.1:53954/collection1/
[junit4] 2> 2924625 T14416 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53954
[junit4] 2> 2924625 T14416 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2924626 T14416 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 2924626 T14416 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2924633 T14381 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2924640 T14382 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:53954",
[junit4] 2> "node_name":"127.0.0.1:53954_",
[junit4] 2> "numShards":"3",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 5
[junit4] 2> 2924643 T14382 oasco.ReplicaMutator.updateState Update state numShards=3 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:53954",
[junit4] 2> "node_name":"127.0.0.1:53954_",
[junit4] 2> "numShards":"3",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 2924650 T14382 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 3
[junit4] 2> 2924657 T14411 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2924658 T14416 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4
[junit4] 2> 2924661 T14411 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4
[junit4] 2> 2926761 T14355 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 2926762 T14355 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2926778 T14355 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53957
[junit4] 2> 2926779 T14355 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
[junit4] 2> 2926780 T14355 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2926781 T14355 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-004
[junit4] 2> 2926782 T14355 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-004/'
[junit4] 2> 2926870 T14355 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-004/solr.xml
[junit4] 2> 2926900 T14355 oasc.CoreContainer.<init> New CoreContainer 1705032371
[junit4] 2> 2926904 T14355 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-004/]
[junit4] 2> 2926905 T14355 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2926906 T14355 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2926907 T14355 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2926907 T14355 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2926908 T14355 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 2926909 T14355 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2926909 T14355 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2926910 T14355 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2926911 T14355 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2926912 T14355 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2926912 T14355 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2926914 T14355 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2926914 T14355 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2926915 T14355 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2926916 T14355 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53946/solr
[junit4] 2> 2926916 T14355 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2926917 T14355 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2926919 T14355 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2926924 T14428 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4cd47ece name:ZooKeeperConnection Watcher:127.0.0.1:53946 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2926925 T14355 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2926925 T14355 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2926931 T14355 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2926944 T14431 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@253819cb name:ZooKeeperConnection Watcher:127.0.0.1:53946/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2926944 T14355 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2926988 T14355 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2928038 T14355 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53957_
[junit4] 2> 2928040 T14355 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53957_
[junit4] 2> 2928059 T14355 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2928083 T14432 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 2928083 T14432 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2928088 T14381 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2928091 T14432 oasc.ZkController.preRegister Registering watch for external collection collection1
[junit4] 2> 2928091 T14432 oascc.ZkStateReader.addZkWatch addZkWatch collection1
[junit4] 2> 2928092 T14382 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:53957",
[junit4] 2> "node_name":"127.0.0.1:53957_",
[junit4] 2> "numShards":"3",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 5
[junit4] 2> 2928097 T14432 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper...
[junit4] 2> 2928097 T14382 oasco.ReplicaMutator.updateState Update state numShards=3 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:53957",
[junit4] 2> "node_name":"127.0.0.1:53957_",
[junit4] 2> "numShards":"3",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 2928099 T14382 oasco.ReplicaMutator.updateState Collection already exists with numShards=3
[junit4] 2> 2928099 T14382 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard3
[junit4] 2> 2928102 T14432 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4
[junit4] 2> 2928104 T14432 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2928105 T14382 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 4
[junit4] 2> 2928107 T14431 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2928107 T14411 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2928113 T14431 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5
[junit4] 2> 2928115 T14411 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5
[junit4] 2> 2929105 T14432 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2929106 T14432 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 2929109 T14432 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2929109 T14432 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2929114 T14432 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2929115 T14432 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-004/collection1/'
[junit4] 2> 2929117 T14432 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 2929118 T14432 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 2929119 T14432 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 2929161 T14432 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 2929167 T14432 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 2929184 T14432 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 2929191 T14432 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2929207 T14432 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2929211 T14432 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 2929221 T14432 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2929417 T14432 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2929418 T14432 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2929419 T14432 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2929428 T14432 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2929513 T14432 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 2929513 T14432 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 2929514 T14432 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-004/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/jetty2/
[junit4] 2> 2929514 T14432 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8ad79f4
[junit4] 2> 2929516 T14432 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/jetty2
[junit4] 2> 2929517 T14432 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/jetty2/index/
[junit4] 2> 2929518 T14432 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 2929519 T14432 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/jetty2/index
[junit4] 2> 2929520 T14432 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=87.568359375, floorSegmentMB=1.501953125, forceMergeDeletesPctAllowed=27.55218996331614, segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8881378966558299
[junit4] 2> 2929527 T14432 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 2929527 T14432 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2929537 T14432 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2929539 T14432 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2929539 T14432 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2929539 T14432 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2929540 T14432 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2929540 T14432 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2929542 T14432 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2929544 T14432 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2929544 T14432 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2929549 T14432 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2929550 T14432 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2929550 T14432 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2929551 T14432 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2929552 T14432 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 2929553 T14432 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
[junit4] 2> 2929558 T14432 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 2929560 T14432 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 2929561 T14432 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 2929570 T14432 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 2929571 T14432 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 2929572 T14432 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 2929574 T14432 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 2929575 T14432 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 2929576 T14432 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 2929579 T14432 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 2929580 T14432 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2929581 T14432 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2929583 T14432 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2929598 T14432 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2929602 T14432 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2929604 T14432 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2929607 T14432 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2929608 T14432 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 2929611 T14432 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2929611 T14432 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2929613 T14432 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=47.3642578125, floorSegmentMB=0.8271484375, forceMergeDeletesPctAllowed=23.156128234359365, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 2929615 T14432 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 2929615 T14432 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2929616 T14432 oass.SolrIndexSearcher.<init> Opening Searcher@2d426fab[collection1] main
[junit4] 2> 2929617 T14432 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2929619 T14432 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2929620 T14432 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2929623 T14432 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2929623 T14432 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 2929624 T14432 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2929626 T14432 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 2929627 T14432 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2929627 T14432 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 2929628 T14432 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2929630 T14432 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2929631 T14433 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2d426fab[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2929633 T14436 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53957 collection:collection1 shard:shard3
[junit4] 2> 2929637 T14355 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2929639 T14355 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2929643 T14436 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 2929659 T14436 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 2929668 T14381 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2929671 T14436 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2929671 T14436 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C3655 name=collection1 org.apache.solr.core.SolrCore@1f72145c url=http://127.0.0.1:53957/collection1 node=127.0.0.1:53957_ C3655_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:53957, node_name=127.0.0.1:53957_, state=down}
[junit4] 2> 2929672 T14436 C3655 P53957 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53957/collection1/
[junit4] 2> 2929673 T14436 C3655 P53957 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2929675 T14436 C3655 P53957 oasc.SyncStrategy.syncToMe http://127.0.0.1:53957/collection1/ has no replicas
[junit4] 2> 2929675 T14436 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53957/collection1/ shard3
[junit4] 2> 2929675 T14436 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 2929680 T14382 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard3",
[junit4] 2> "collection":"collection1"} current state version: 5
[junit4] 2> 2929691 T14382 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 5
[junit4] 2> 2929695 T14411 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2929700 T14411 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 6
[junit4] 2> 2929701 T14431 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2929707 T14431 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 6
[junit4] 2> 2929719 T14382 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard3",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:53957",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 5
[junit4] 2> 2929721 T14382 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 6
[junit4] 2> 2929723 T14411 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2929725 T14411 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 7
[junit4] 2> 2929730 T14431 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2929733 T14431 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 7
[junit4] 2> 2929743 T14381 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2929784 T14436 oasc.ZkController.register We are http://127.0.0.1:53957/collection1/ and leader is http://127.0.0.1:53957/collection1/
[junit4] 2> 2929784 T14436 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53957
[junit4] 2> 2929785 T14436 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2929785 T14436 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 2929785 T14436 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2929788 T14381 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2929792 T14382 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "rol
[...truncated too long message...]
l.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] 2> at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 36) Thread[id=14434, name=Thread-6175, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Object.wait(Object.java:502)
[junit4] 2> at org.apache.solr.core.CloserThread.run(CoreContainer.java:929)
[junit4] 2> 37) Thread[id=14438, name=qtp1677243178-14438 Selector0, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
[junit4] 2> at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198)
[junit4] 2> at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
[junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
[junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {rnd_b=PostingsFormat(name=LuceneFixedGap), _version_=PostingsFormat(name=LuceneVarGapFixedInterval), a_t=Lucene50(blocksize=128), a_i=PostingsFormat(name=LuceneFixedGap), id=PostingsFormat(name=LuceneFixedGap)}, docValues:{}, sim=DefaultSimilarity, locale=de_CH, timezone=America/Shiprock
[junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.8.0_20 (64-bit)/cpus=2,threads=51,free=214109304,total=358612992
[junit4] 2> NOTE: All tests run in this JVM: [TestIntervalFaceting, TestCollationField, TestFastWriter, DeleteShardTest, CursorPagingTest, TestRandomDVFaceting, DistributedIntervalFacetingTest, ClusterStateTest, TestQueryTypes, DocumentAnalysisRequestHandlerTest, HighlighterMaxOffsetTest, TestDFRSimilarityFactory, ZkSolrClientTest, TestFieldSortValues, TestManagedSchema, RegexBoostProcessorTest, TestCollationFieldDocValues, CollectionsAPIDistributedZkTest, TestCopyFieldCollectionResource, IndexSchemaRuntimeFieldTest, TestSolr4Spatial, SoftAutoCommitTest, RecoveryZkTest, TestSolrDeletionPolicy2, ZkCLITest, NumericFieldsTest, FastVectorHighlighterTest, TestExpandComponent, TestPostingsSolrHighlighter, TestOmitPositions, TestCloudInspectUtil, TestFieldCollectionResource, TestQuerySenderNoQuery, CacheHeaderTest, TestManagedStopFilterFactory, IndexSchemaTest, DirectSolrSpellCheckerTest, TestReloadAndDeleteDocs, CoreAdminHandlerTest, SSLMigrationTest, SpellCheckComponentTest, TestDefaultStatsCache, CloudExitableDirectoryReaderTest, ChaosMonkeyNothingIsSafeTest, TestDefaultSimilarityFactory, SyncSliceTest, TestSolrJ, RemoteQueryErrorTest, SolrRequestParserTest, TestChildDocTransformer, CurrencyFieldXmlFileTest, TestPHPSerializedResponseWriter, TestFiltering, TestRawResponseWriter, TestDocSet, QueryResultKeyTest, ReplicationFactorTest, DeleteReplicaTest, TestRealTimeGet, SimpleMLTQParserTest, RAMDirectoryFactoryTest, TestRecoveryHdfs, TestAnalyzedSuggestions, TestUpdate, ScriptEngineTest, DeleteInactiveReplicaTest, InfoHandlerTest, ReturnFieldsTest, TestDefaultSearchFieldResource, DistributedSuggestComponentTest, DirectUpdateHandlerOptimizeTest, TestReplicationHandler, PolyFieldTest, TestManagedSchemaFieldResource, ZkControllerTest, ConnectionManagerTest, BasicDistributedZk2Test, TestSolrConfigHandlerCloud, TestClusterStateMutator, TestSurroundQueryParser, TestRequestStatusCollectionAPI, SolrXmlInZkTest, SpatialFilterTest, ExternalFileFieldSortTest, DisMaxRequestHandlerTest, DistributedQueryElevationComponentTest, CopyFieldTest, SolrCoreCheckLockOnStartupTest, TestMiniSolrCloudCluster, TestTolerantSearch, OutOfBoxZkACLAndCredentialsProvidersTest, TestCSVResponseWriter, StatelessScriptUpdateProcessorFactoryTest, TestFunctionQuery, HdfsChaosMonkeySafeLeaderTest, CoreContainerCoreInitFailuresTest, ShowFileRequestHandlerTest, CursorMarkTest, EnumFieldTest, TestConfigReload, TestElisionMultitermQuery, DocValuesMultiTest, URLClassifyProcessorTest, TestShortCircuitedRequests, DocumentBuilderTest, TestStandardQParsers, CachingDirectoryFactoryTest, AtomicUpdatesTest, TestNRTOpen, TestPartialUpdateDeduplication, DistributedFacetPivotLongTailTest, SharedFSAutoReplicaFailoverUtilsTest, TestCloudManagedSchemaConcurrent, SuggesterFSTTest, ClusterStateUpdateTest, TestExactSharedStatsCache, NoCacheHeaderTest, UpdateRequestProcessorFactoryTest, TestCollectionAPI, TestQueryUtils, DocValuesMissingTest, TestSolrConfigHandlerConcurrent, TestStressLucene, TestLFUCache, HdfsWriteToMultipleCollectionsTest, TestIndexSearcher, SimplePostToolTest, TestSolrDeletionPolicy1, TestLeaderElectionZkExpiry, TestTrie, MinimalSchemaTest, SOLR749Test, TestDynamicFieldCollectionResource, TestSolrXmlPersistor, DistributedTermsComponentTest, HttpPartitionTest, TestFuzzyAnalyzedSuggestions, TestManagedSchemaDynamicFieldResource, TestSolrDynamicMBean, AnalysisErrorHandlingTest, SolrIndexSplitterTest, TestNonNRTOpen, TestManagedSynonymFilterFactory, ShardRoutingTest, TestValueSourceCache, SchemaVersionSpecificBehaviorTest, BlockDirectoryTest, TestStressVersions, TestSort, HdfsBasicDistributedZk2Test, TestSystemIdResolver, PeerSyncTest, CoreAdminRequestStatusTest, TestBM25SimilarityFactory, TestSortingResponseWriter, DistributedFacetPivotWhiteBoxTest, HdfsSyncSliceTest, LeaderFailoverAfterPartitionTest, TestDocBasedVersionConstraints, TestLRUStatsCache, HardAutoCommitTest, DateFieldTest, AddSchemaFieldsUpdateProcessorFactoryTest, CoreAdminCreateDiscoverTest, ConvertedLegacyTest, DateMathParserTest, UUIDFieldTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, SearchHandlerTest, BadCopyFieldTest, TestRecovery, TestInitQParser, SynonymTokenizerTest, TestLuceneMatchVersion, PreAnalyzedUpdateProcessorTest, TestAddFieldRealTimeGet, SuggesterWFSTTest, TestBinaryField, TestMaxScoreQueryParser, CustomCollectionTest, TestSolrConfigHandler, OverseerRolesTest, FieldMutatingUpdateProcessorTest, SolrInfoMBeanTest, TestCoreDiscovery, TestDistributedGrouping, AlternateDirectoryTest, TestUtils, UnloadDistributedZkTest, PreAnalyzedFieldTest, TestCursorMarkWithoutUniqueKey, RollingRestartTest, DistributedFacetPivotSmallAdvancedTest, TestOverriddenPrefixQueryForCustomFieldType, HdfsCollectionsAPIDistributedZkTest, AnalyticsMergeStrategyTest, TestConfig, ResponseHeaderTest, DistanceFunctionTest, TestOrdValues, SortByFunctionTest, TermsComponentTest, TestFieldResource, TestJoin, RequiredFieldsTest, MergeStrategyTest, TestSearcherReuse, MBeansHandlerTest, TestExceedMaxTermLength, TestQuerySenderListener, TestClassNameShortening, BadComponentTest, TestDistribDocBasedVersion, PathHierarchyTokenizerFactoryTest, DistributedDebugComponentTest, ParsingFieldUpdateProcessorsTest, LegacyHTMLStripCharFilterTest, DistribDocExpirationUpdateProcessorTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=ACA3BF961C3082C4 -Dtests.slow=true -Dtests.locale=de_CH -Dtests.timezone=America/Shiprock -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s | ChaosMonkeySafeLeaderTest (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([ACA3BF961C3082C4]:0)
[junit4] Completed in 7224.98s, 1 test, 2 errors <<< FAILURES!
[...truncated 697 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:519: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:467: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:61: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:187: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:510: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1349: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:956: There were test failures: 460 suites, 1857 tests, 1 suite-level error, 1 error, 903 ignored (15 assumptions)
Total time: 211 minutes 53 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseG1GC (asserts: true)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.8.0) - Build # 2027
- Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/2027/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC (asserts: true)
1 tests failed.
FAILED: org.apache.solr.cloud.DeleteReplicaTest.testDistribSearch
Error Message:
Should have had a good message here
Stack Trace:
java.lang.AssertionError: Should have had a good message here
at __randomizedtesting.SeedInfo.seed([10E79FF26220171C:910111EA157F7720]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:138)
at org.apache.solr.cloud.DeleteReplicaTest.doTest(DeleteReplicaTest.java:89)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:868)
at sun.reflect.GeneratedMethodAccessor39.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 9913 lines...]
[junit4] Suite: org.apache.solr.cloud.DeleteReplicaTest
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/init-core-data-001
[junit4] 2> 4064744 T17563 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
[junit4] 2> 4064744 T17563 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 4064748 T17563 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 4064749 T17563 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 4064751 T17564 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 4064852 T17563 oasc.ZkTestServer.run start zk server on port:54188
[junit4] 2> 4064853 T17563 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 4064858 T17563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4064867 T17571 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17c86bae name:ZooKeeperConnection Watcher:127.0.0.1:54188 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4064868 T17563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4064868 T17563 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 4064869 T17563 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 4064878 T17563 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 4064880 T17563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4064884 T17574 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12045c4f name:ZooKeeperConnection Watcher:127.0.0.1:54188/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4064885 T17563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4064885 T17563 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 4064885 T17563 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 4064895 T17563 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 4064901 T17563 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 4064908 T17563 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 4064918 T17563 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 4064919 T17563 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 4064931 T17563 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 4064932 T17563 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 4064939 T17563 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 4064939 T17563 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 4064949 T17563 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 4064950 T17563 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 4064956 T17563 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 4064957 T17563 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 4064964 T17563 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 4064965 T17563 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 4064972 T17563 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 4064974 T17563 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 4064982 T17563 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 4064983 T17563 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 4064991 T17563 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 4064992 T17563 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 4065000 T17563 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 4065001 T17563 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 4065010 T17563 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 4065011 T17563 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 4066956 T17563 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 4066962 T17563 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54191
[junit4] 2> 4066963 T17563 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
[junit4] 2> 4066963 T17563 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 4066964 T17563 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-002
[junit4] 2> 4066964 T17563 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-002/'
[junit4] 2> 4067005 T17563 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-002/solr.xml
[junit4] 2> 4067034 T17563 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-002
[junit4] 2> 4067037 T17563 oasc.CoreContainer.<init> New CoreContainer 1997628382
[junit4] 2> 4067038 T17563 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-002/]
[junit4] 2> 4067039 T17563 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 4067040 T17563 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 4067041 T17563 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 4067041 T17563 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 4067041 T17563 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 4067042 T17563 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 4067042 T17563 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 4067044 T17563 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 4067044 T17563 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 4067044 T17563 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 4067045 T17563 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 4067045 T17563 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 4067047 T17563 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 4067047 T17563 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 4067048 T17563 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54188/solr
[junit4] 2> 4067048 T17563 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 4067049 T17563 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 4067050 T17563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4067054 T17586 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10931f2a name:ZooKeeperConnection Watcher:127.0.0.1:54188 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4067055 T17563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4067055 T17563 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 4067060 T17563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4067064 T17589 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@46905343 name:ZooKeeperConnection Watcher:127.0.0.1:54188/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4067064 T17563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4067067 T17563 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 4067076 T17563 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 4067085 T17563 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 4067094 T17563 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 4067102 T17563 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 4067113 T17563 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 4067117 T17563 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54191_
[junit4] 2> 4067119 T17563 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54191_
[junit4] 2> 4067128 T17563 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 4067134 T17563 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 4067140 T17563 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 4067145 T17563 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:54191_
[junit4] 2> 4067145 T17563 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 4067152 T17563 oasc.Overseer.start Overseer (id=93064833235550211-127.0.0.1:54191_-n_0000000000) starting
[junit4] 2> 4067162 T17563 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 4067189 T17563 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 4067192 T17591 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 4067196 T17590 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 4067198 T17563 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 4067204 T17563 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 4067208 T17563 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 4067224 T17563 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-002
[junit4] 2> 4068102 T17563 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-002/conf/
[junit4] 2> 4068239 T17563 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 4068242 T17563 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 4068242 T17563 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 4068243 T17563 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 4068244 T17563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4068247 T17596 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b4332a0 name:ZooKeeperConnection Watcher:127.0.0.1:54188/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4068247 T17563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4068247 T17563 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 4068250 T17563 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 4068261 T17563 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 4068261 T17563 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
[junit4] 2> 4068262 T17563 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 4068263 T17563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4068265 T17599 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@72d3ef19 name:ZooKeeperConnection Watcher:127.0.0.1:54188/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4068266 T17563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4068266 T17563 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 4068270 T17589 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 4068280 T17590 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 0, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":2} current state version: 0
[junit4] 2> 4068281 T17590 oasco.ClusterStateMutator.createCollection building a new cName: collection1
[junit4] 2> 4068305 T17590 oasco.ZkStateWriter.writePendingUpdates going to create_collection /collections/collection1/state.json
[junit4] 2> 4068325 T17589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 4068326 T17596 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 4070225 T17563 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 4070226 T17563 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 4070231 T17563 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54196
[junit4] 2> 4070231 T17563 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
[junit4] 2> 4070232 T17563 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 4070232 T17563 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-003
[junit4] 2> 4070233 T17563 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-003/'
[junit4] 2> 4070273 T17563 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-003/solr.xml
[junit4] 2> 4070286 T17563 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-003
[junit4] 2> 4070288 T17563 oasc.CoreContainer.<init> New CoreContainer 1956183476
[junit4] 2> 4070288 T17563 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-003/]
[junit4] 2> 4070289 T17563 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 4070289 T17563 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 4070290 T17563 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 4070290 T17563 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 4070291 T17563 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 4070291 T17563 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 4070292 T17563 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 4070293 T17563 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 4070293 T17563 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 4070294 T17563 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 4070294 T17563 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 4070294 T17563 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 4070295 T17563 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 4070295 T17563 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 4070296 T17563 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54188/solr
[junit4] 2> 4070297 T17563 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 4070297 T17563 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 4070301 T17563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4070303 T17611 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16afc94f name:ZooKeeperConnection Watcher:127.0.0.1:54188 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4070303 T17563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4070303 T17563 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 4070310 T17563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4070315 T17614 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b51050f name:ZooKeeperConnection Watcher:127.0.0.1:54188/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4070316 T17563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4070334 T17563 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 4071353 T17563 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54196_
[junit4] 2> 4071357 T17563 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54196_
[junit4] 2> 4071375 T17563 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 4071386 T17563 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-003
[junit4] 2> 4072275 T17563 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-003/conf/
[junit4] 2> 4072392 T17563 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 4072394 T17563 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 4072395 T17563 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 4074474 T17563 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 4074476 T17563 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 4074481 T17563 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54199
[junit4] 2> 4074481 T17563 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
[junit4] 2> 4074482 T17563 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 4074482 T17563 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-004
[junit4] 2> 4074483 T17563 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-004/'
[junit4] 2> 4074535 T17563 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-004/solr.xml
[junit4] 2> 4074551 T17563 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-004
[junit4] 2> 4074551 T17563 oasc.CoreContainer.<init> New CoreContainer 1920523434
[junit4] 2> 4074552 T17563 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-004/]
[junit4] 2> 4074552 T17563 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 4074553 T17563 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 4074553 T17563 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 4074553 T17563 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 4074553 T17563 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 4074554 T17563 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 4074554 T17563 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 4074555 T17563 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 4074555 T17563 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 4074555 T17563 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 4074555 T17563 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 4074556 T17563 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 4074556 T17563 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 4074559 T17563 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 4074559 T17563 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54188/solr
[junit4] 2> 4074560 T17563 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 4074561 T17563 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 4074565 T17563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4074571 T17627 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3fd088fb name:ZooKeeperConnection Watcher:127.0.0.1:54188 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4074571 T17563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4074571 T17563 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 4074577 T17563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4074580 T17630 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b838b20 name:ZooKeeperConnection Watcher:127.0.0.1:54188/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4074581 T17563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4074596 T17563 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 4075612 T17563 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54199_
[junit4] 2> 4075615 T17563 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54199_
[junit4] 2> 4075633 T17563 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 4075644 T17563 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-004
[junit4] 2> 4076552 T17563 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-004/conf/
[junit4] 2> 4076714 T17563 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 4076718 T17563 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 4076718 T17563 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 4078791 T17563 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 4078792 T17563 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 4078798 T17563 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54202
[junit4] 2> 4078798 T17563 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
[junit4] 2> 4078798 T17563 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 4078799 T17563 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-005
[junit4] 2> 4078799 T17563 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-005/'
[junit4] 2> 4078844 T17563 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-005/solr.xml
[junit4] 2> 4078861 T17563 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-005
[junit4] 2> 4078862 T17563 oasc.CoreContainer.<init> New CoreContainer 1960246792
[junit4] 2> 4078863 T17563 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-005/]
[junit4] 2> 4078864 T17563 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 4078864 T17563 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 4078865 T17563 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 4078865 T17563 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 4078867 T17563 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 4078867 T17563 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 4078868 T17563 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 4078869 T17563 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 4078869 T17563 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 4078869 T17563 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 4078870 T17563 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 4078870 T17563 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 4078871 T17563 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 4078871 T17563 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 4078872 T17563 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54188/solr
[junit4] 2> 4078873 T17563 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 4078874 T17563 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 4078876 T17563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4078880 T17643 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6de2d78 name:ZooKeeperConnection Watcher:127.0.0.1:54188 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4078881 T17563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4078881 T17563 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 4078887 T17563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4078890 T17646 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d870676 name:ZooKeeperConnection Watcher:127.0.0.1:54188/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4078891 T17563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4078913 T17563 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 4079932 T17563 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54202_
[junit4] 2> 4079933 T17563 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54202_
[junit4] 2> 4079950 T17563 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 4079960 T17563 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-005
[junit4] 2> 4080951 T17563 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-005/conf/
[junit4] 2> 4081070 T17563 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 4081073 T17563 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 4081073 T17563 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 4083050 T17563 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
[junit4] 2> 4083051 T17563 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 4083060 T17563 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54205
[junit4] 2> 4083060 T17563 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
[junit4] 2> 4083060 T17563 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 4083061 T17563 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-006
[junit4] 2> 4083061 T17563 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-006/'
[junit4] 2> 4083114 T17563 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-006/solr.xml
[junit4] 2> 4083127 T17563 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-006
[junit4] 2> 4083128 T17563 oasc.CoreContainer.<init> New CoreContainer 40371216
[junit4] 2> 4083128 T17563 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-006/]
[junit4] 2> 4083130 T17563 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 4083130 T17563 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 4083130 T17563 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 4083131 T17563 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 4083132 T17563 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 4083132 T17563 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 4083132 T17563 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 4083133 T17563 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 4083133 T17563 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 4083133 T17563 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 4083134 T17563 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 4083134 T17563 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 4083134 T17563 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 4083135 T17563 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 4083135 T17563 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54188/solr
[junit4] 2> 4083136 T17563 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 4083137 T17563 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 4083139 T17563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4083143 T17659 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c5490b1 name:ZooKeeperConnection Watcher:127.0.0.1:54188 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4083143 T17563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4083143 T17563 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 4083148 T17563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4083151 T17662 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f47ee3b name:ZooKeeperConnection Watcher:127.0.0.1:54188/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4083151 T17563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4083168 T17563 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 4084188 T17563 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54205_
[junit4] 2> 4084193 T17563 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54205_
[junit4] 2> 4084215 T17563 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 4084223 T17563 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-006
[junit4] 2> 4085244 T17563 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-006/conf/
[junit4] 2> 4085381 T17563 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 4085384 T17563 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 4085384 T17563 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 4085391 T17563 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 4085396 T17563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4085399 T17666 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b4b6a84 name:ZooKeeperConnection Watcher:127.0.0.1:54188/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4085399 T17563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4085399 T17563 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 4085401 T17563 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 4085422 T17563 oasc.AbstractFullDistribZkTestBase.createCollection Creating collection with stateFormat=2: delLiveColl
[junit4] 2> 4085423 T17563 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 4085424 T17563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4085433 T17669 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b4d14a2 name:ZooKeeperConnection Watcher:127.0.0.1:54188/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 4085433 T17563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 4085434 T17563 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 4085439 T17563 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 4085458 T17604 oasha.CollectionsHandler.handleCreateAction Creating Collection : replicationFactor=2&maxShardsPerNode=2&name=delLiveColl&action=CREATE&numShards=2&stateFormat=2&wt=javabin&version=2
[junit4] 2> 4085460 T17589 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/collection-queue-work state SyncConnected
[junit4] 2> 4085464 T17591 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"create",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"delLiveColl",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "stateFormat":"2"}
[junit4] 2> 4085467 T17670 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : create , {
[junit4] 2> "operation":"create",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"delLiveColl",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "stateFormat":"2"}
[junit4] 2> 4085470 T17670 oasc.OverseerCollectionProcessor.createConfNode Only one config set found in zk - using it:conf1
[junit4] 2> 4085471 T17670 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/delLiveColl
[junit4] 2> 4085473 T17670 oascc.SolrZkClient.makePath makePath: /collections/delLiveColl
[junit4] 2> 4085484 T17589 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 4085487 T17590 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"delLiveColl",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "stateFormat":"2"} current state version: 1
[junit4] 2> 4085488 T17590 oasco.ClusterStateMutator.createCollection building a new cName: delLiveColl
[junit4] 2> 4085494 T17590 oasco.ZkStateWriter.writePendingUpdates going to create_collection /collections/delLiveColl/state.json
[junit4] 2> 4085497 T17614 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 4085498 T17630 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 4085498 T17669 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 4085499 T17589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 4085501 T17596 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 4085502 T17662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 4085502 T17646 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 4085503 T17666 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 4085686 T17670 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection delLiveColl, shardNames [shard1, shard2] , replicationFactor : 2
[junit4] 2> 4085687 T17670 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard1_replica1 as part of slice shard1 of collection delLiveColl on 127.0.0.1:54202_
[junit4] 2> 4085689 T17670 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard1_replica2 as part of slice shard1 of collection delLiveColl on 127.0.0.1:54196_
[junit4] 2> 4085692 T17638 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delLiveColl_shard1_replica1&action=CREATE&numShards=2&collection=delLiveColl&shard=shard1&wt=javabin&version=2
[junit4] 2> 4085694 T17670 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard2_replica1 as part of slice shard2 of collection delLiveColl on 127.0.0.1:54191_
[junit4] 2> 4085698 T17606 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delLiveColl_shard1_replica2&action=CREATE&numShards=2&collection=delLiveColl&shard=shard1&wt=javabin&version=2
[junit4] 2> 4085699 T17670 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard2_replica2 as part of slice shard2 of collection delLiveColl on 127.0.0.1:54199_
[junit4] 2> 4085704 T17578 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delLiveColl_shard2_replica1&action=CREATE&numShards=2&collection=delLiveColl&shard=shard2&wt=javabin&version=2
[junit4] 2> 4085710 T17638 oasc.ZkController.publish publishing core=delLiveColl_shard1_replica1 state=down collection=delLiveColl
[junit4] 2> 4085716 T17620 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delLiveColl_shard2_replica2&action=CREATE&numShards=2&collection=delLiveColl&shard=shard2&wt=javabin&version=2
[junit4] 2> 4085717 T17606 oasc.ZkController.publish publishing core=delLiveColl_shard1_replica2 state=down collection=delLiveColl
[junit4] 2> 4085721 T17589 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 4085723 T17578 oasc.ZkController.publish publishing core=delLiveColl_shard2_replica1 state=down collection=delLiveColl
[junit4] 2> 4085727 T17638 oasc.ZkController.preRegister Registering watch for external collection delLiveColl
[junit4] 2> 4085727 T17638 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl
[junit4] 2> 4085729 T17590 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core":"delLiveColl_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54202",
[junit4] 2> "node_name":"127.0.0.1:54202_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 4085730 T17638 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper...
[junit4] 2> 4085732 T17620 oasc.ZkController.publish publishing core=delLiveColl_shard2_replica2 state=down collection=delLiveColl
[junit4] 2> 4085733 T17606 oasc.ZkController.preRegister Registering watch for external collection delLiveColl
[junit4] 2> 4085734 T17606 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl
[junit4] 2> 4085735 T17590 oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "core":"delLiveColl_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54202",
[junit4] 2> "node_name":"127.0.0.1:54202_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "operation":"state"}
[junit4] 2> 4085738 T17606 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper...
[junit4] 2> 4085738 T17638 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 0
[junit4] 2> 4085739 T17638 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 4085743 T17578 oasc.ZkController.preRegister Registering watch for external collection delLiveColl
[junit4] 2> 4085745 T17620 oasc.ZkController.preRegister Registering watch for external collection delLiveColl
[junit4] 2> 4085746 T17620 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl
[junit4] 2> 4085747 T17606 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 0
[junit4] 2> 4085749 T17606 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 4085749 T17620 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper...
[junit4] 2> 4085753 T17590 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 3, message = {
[junit4] 2> "core":"delLiveColl_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54196",
[junit4] 2> "node_name":"127.0.0.1:54196_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 4085754 T17620 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 0
[junit4] 2> 4085755 T17620 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 4085755 T17590 oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "core":"delLiveColl_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54196",
[junit4] 2> "node_name":"127.0.0.1:54196_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "operation":"state"}
[junit4] 2> 4085760 T17589 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 4085763 T17590 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 3, message = {
[junit4] 2> "core":"delLiveColl_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54191",
[junit4] 2> "node_name":"127.0.0.1:54191_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 4085765 T17590 oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "core":"delLiveColl_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54191",
[junit4] 2> "node_name":"127.0.0.1:54191_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "operation":"state"}
[junit4] 2> 4085773 T17590 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core":"delLiveColl_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54199",
[junit4] 2> "node_name":"127.0.0.1:54199_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 4085775 T17590 oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "core":"delLiveColl_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54199",
[junit4] 2> "node_name":"127.0.0.1:54199_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "operation":"state"}
[junit4] 2> 4085780 T17589 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 4085782 T17590 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/delLiveColl/state.json version: 0
[junit4] 2> 4085786 T17630 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 4085786 T17646 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 4085786 T17614 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 4085788 T17630 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1
[junit4] 2> 4085789 T17646 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1
[junit4] 2> 4085790 T17614 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1
[junit4] 2> 4085804 T17578 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl
[junit4] 2> 4085807 T17578 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper...
[junit4] 2> 4085812 T17578 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1
[junit4] 2> 4085813 T17578 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 4085813 T17578 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard2_replica1
[junit4] 2> 4085813 T17578 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
[junit4] 2> 4085815 T17578 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 4085815 T17578 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 4085818 T17578 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 4085819 T17578 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-002/delLiveColl_shard2_replica1/'
[junit4] 2> 4085916 T17578 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 4085929 T17578 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 4085952 T17578 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 4085963 T17578 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 4086002 T17578 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 4086006 T17578 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 4086017 T17578 oass.IndexSchema.readSchema [delLiveColl_shard2_replica1] Schema name=test
[junit4] 2> 4086218 T17578 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 4086228 T17578 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 4086230 T17578 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 4086302 T17578 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 4086308 T17578 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 4086321 T17578 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 4086323 T17578 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 4086324 T17578 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 4086324 T17578 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 4086328 T17578 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 4086328 T17578 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 4086329 T17578 oasc.CoreContainer.create Creating SolrCore 'delLiveColl_shard2_replica1' using configuration from collection delLiveColl
[junit4] 2> 4086329 T17578 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 4086331 T17578 oasc.SolrCore.<init> [delLiveColl_shard2_replica1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-002/delLiveColl_shard2_replica1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-002/delLiveColl_shard2_replica1/data/
[junit4] 2> 4086331 T17578 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ada7b19
[junit4] 2> 4086331 T17578 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-002/delLiveColl_shard2_replica1/data
[junit4] 2> 4086333 T17578 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-002/delLiveColl_shard2_replica1/data/index/
[junit4] 2> 4086334 T17578 oasc.SolrCore.initIndex WARN [delLiveColl_shard2_replica1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-002/delLiveColl_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 4086335 T17578 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-002/delLiveColl_shard2_replica1/data/index
[junit4] 2> 4086336 T17578 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=17, maxMergedSegmentMB=72.794921875, floorSegmentMB=0.330078125, forceMergeDeletesPctAllowed=2.2442943699529625, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.690330101567545
[junit4] 2> 4086338 T17578 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7422468c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7f8d08f1),segFN=segments_1,generation=1}
[junit4] 2> 4086339 T17578 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 4086345 T17578 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 4086345 T17578 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 4086346 T17578 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 4086347 T17578 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 4086348 T17578 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 4086349 T17578 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 4086351 T17578 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 4086352 T17578 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 4086352 T17578 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 4086355 T17578 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 4086356 T17578 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 4086356 T17578 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 4086357 T17578 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 4086358 T17578 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 4086359 T17578 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
[junit4] 2> 4086359 T17578 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 4086360 T17578 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 4086361 T17578 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 4086362 T17578 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 4086363 T17578 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 4086363 T17578 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 4086364 T17578 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 4086365 T17578 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 4086365 T17578 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 4086366 T17578 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 4086367 T17578 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 4086371 T17578 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 4086371 T17578 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 4086380 T17578 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 4086381 T17578 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 4086384 T17578 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 4086387 T17578 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 4086388 T17578 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 4086395 T17578 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 4086396 T17578 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 4086397 T17578 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=30.90234375, floorSegmentMB=2.072265625, forceMergeDeletesPctAllowed=9.269512036797373, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5167761129959357
[junit4] 2> 4086398 T17578 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7422468c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7f8d08f1),segFN=segments_1,generation=1}
[junit4] 2> 4086399 T17578 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 4086400 T17578 oass.SolrIndexSearcher.<init> Opening Searcher@303fe59b[delLiveColl_shard2_replica1] main
[junit4] 2> 4086401 T17578 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 4086403 T17578 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 4086404 T17578 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 4086405 T17578 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 4086406 T17578 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 4086406 T17578 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 4086407 T17578 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 4086408 T17578 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 4086408 T17578 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 4086409 T17578 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 4086410 T17578 oasc.CoreContainer.registerCore registering core: delLiveColl_shard2_replica1
[junit4] 2> 4086410 T17578 oasc.ZkController.register Register replica - core:delLiveColl_shard2_replica1 address:http://127.0.0.1:54191 collection:delLiveColl shard:shard2
[junit4] 2> 4086410 T17675 oasc.SolrCore.registerSearcher [delLiveColl_shard2_replica1] Registered new searcher Searcher@303fe59b[delLiveColl_shard2_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 4086412 T17578 oascc.SolrZkClient.makePath makePath: /collections/delLiveColl/leader_elect/shard2/election
[junit4] 2> 4086426 T17578 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 4086432 T17589 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 4086434 T17578 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=179998ms
[junit4] 2> 4086435 T17590 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"delLiveColl"} current state version: 2
[junit4] 2> 4086550 T17590 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/delLiveColl/state.json version: 1
[junit4] 2> 4086559 T17614 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 4086559 T17589 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 4086559 T17630 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 4086561 T17646 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 4086563 T17630 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2
[junit4] 2> 4086563 T17614 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2
[junit4] 2> 4086564 T17646 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2
[junit4] 2> 4086570 T17589 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2
[junit4] 2> 4086740 T17638 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard1_replica1
[junit4] 2> 4086741 T17638 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
[junit4] 2> 4086744 T17638 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 4086745 T17638 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 4086750 T17606 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard1_replica2
[junit4] 2> 4086753 T17606 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
[junit4] 2> 4086751 T17638 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 4086754 T17638 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-005/delLiveColl_shard1_replica1/'
[junit4] 2> 4086756 T17620 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard2_replica2
[junit4] 2> 4086757 T17620 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
[junit4] 2> 4086763 T17620 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 4086764 T17620 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 4086764 T17606 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 4086765 T17606 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 4086771 T17606 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 4086774 T17606 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-003/delLiveColl_shard1_replica2/'
[junit4] 2> 4086787 T17638 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 4086789 T17620 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 4086789 T17620 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-004/delLiveColl_shard2_replica2/'
[junit4] 2> 4086811 T17638 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 4086815 T17606 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 4086828 T17606 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 4086829 T17620 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 4086835 T17638 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 4086837 T17620 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 4086844 T17638 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 4086851 T17606 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 4086879 T17606 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 4086898 T17638 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 4086899 T17606 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 4086899 T17620 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 4086909 T17620 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 4086922 T17638 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 4086927 T17638 oass.IndexSchema.readSchema [delLiveColl_shard1_replica1] Schema name=test
[junit4] 2> 4086935 T17620 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 4086940 T17606 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 4086946 T17620 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 4086948 T17606 oass.IndexSchema.readSchema [delLiveColl_shard1_replica2] Schema name=test
[junit4] 2> 4086973 T17620 oass.IndexSchema.readSchema [delLiveColl_shard2_replica2] Schema name=test
[junit4] 2> 4087173 T17606 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 4087178 T17606 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 4087184 T17606 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 4087198 T17620 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 4087205 T17620 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 4087207 T17620 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 4087212 T17638 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 4087228 T17638 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 4087230 T17638 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 4087235 T17606 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 4087247 T17606 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 4087257 T17606 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 4087260 T17606 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 4087262 T17606 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 4087262 T17606 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 4087268 T17606 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 4087272 T17606 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 4087275 T17606 oasc.CoreContainer.create Creating SolrCore 'delLiveColl_shard1_replica2' using configuration from collection delLiveColl
[junit4] 2> 4087277 T17606 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 4087278 T17606 oasc.SolrCore.<init> [delLiveColl_shard1_replica2] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-003/delLiveColl_shard1_replica2/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-003/delLiveColl_shard1_replica2/data/
[junit4] 2> 4087278 T17606 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ada7b19
[junit4] 2> 4087282 T17606 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-003/delLiveColl_shard1_replica2/data
[junit4] 2> 4087276 T17638 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 4087283 T17606 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001/tempDir-003/delLiveColl_shard1_replica2/data/index/
[junit4] 2> 4087287 T17606 oasc.SolrCore.initIndex WARN [delLiveColl_shard1_replica2] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-M
[...truncated too long message...]
ins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-10E79FF26220171C-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {}, docValues:{}, sim=DefaultSimilarity, locale=nl, timezone=UTC
[junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.8.0_20 (64-bit)/cpus=2,threads=1,free=315539568,total=519057408
[junit4] 2> NOTE: All tests run in this JVM: [ZkSolrClientTest, ChaosMonkeyNothingIsSafeTest, TestRemoteStreaming, TestReplicaProperties, TestRandomMergePolicy, TestIndexingPerformance, ChangedSchemaMergeTest, TestIntervalFaceting, ReplicationFactorTest, DocumentAnalysisRequestHandlerTest, RAMDirectoryFactoryTest, HdfsRecoveryZkTest, HdfsUnloadDistributedZkTest, TestWordDelimiterFilterFactory, LegacyHTMLStripCharFilterTest, SimpleFacetsTest, SystemInfoHandlerTest, DistributedSpellCheckComponentTest, TestMiniSolrCloudCluster, TestCollationField, HdfsWriteToMultipleCollectionsTest, IndexBasedSpellCheckerTest, TestClusterStateMutator, TestSolr4Spatial, TestLRUCache, TestSolrJ, SolrCoreTest, ZkStateWriterTest, TestChildDocTransformer, MultiThreadedOCPTest, MultiTermTest, TestFunctionQuery, CoreAdminCreateDiscoverTest, TestSearcherReuse, TestFuzzyAnalyzedSuggestions, SolrInfoMBeanTest, TestFileDictionaryLookup, TestSimpleQParserPlugin, TestJoin, TriLevelCompositeIdRoutingTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestArbitraryIndexDir, SolrCmdDistributorTest, CachingDirectoryFactoryTest, SynonymTokenizerTest, PreAnalyzedUpdateProcessorTest, CSVRequestHandlerTest, TestElisionMultitermQuery, DistributedQueryComponentCustomSortTest, CustomCollectionTest, NoCacheHeaderTest, AnalysisAfterCoreReloadTest, TestUtils, TestDynamicFieldCollectionResource, TestComponentsName, TestCollapseQParserPlugin, TestManagedSchema, AlternateDirectoryTest, OutputWriterTest, TestDynamicFieldResource, DistribCursorPagingTest, TestDistributedMissingSort, TestTolerantSearch, TestRecovery, BJQParserTest, TestPseudoReturnFields, ExitableDirectoryReaderTest, TestInitQParser, TestDefaultSearchFieldResource, TestManagedSchemaFieldResource, TestPhraseSuggestions, TestFaceting, ScriptEngineTest, DistributedIntervalFacetingTest, TermsComponentTest, LukeRequestHandlerTest, TestCursorMarkWithoutUniqueKey, TestCoreContainer, CopyFieldTest, TestSortingResponseWriter, TestQueryUtils, TestBinaryResponseWriter, DistribDocExpirationUpdateProcessorTest, FileBasedSpellCheckerTest, TestDistributedSearch, TestRequestStatusCollectionAPI, ReturnFieldsTest, TestUniqueKeyFieldResource, QueryParsingTest, TestDocumentBuilder, HttpPartitionTest, AnalyticsQueryTest, SharedFSAutoReplicaFailoverTest, TestBlobHandler, DocValuesMissingTest, PrimUtilsTest, JsonLoaderTest, RankQueryTest, BasicFunctionalityTest, TestNoOpRegenerator, TestReload, TestSort, TestExceedMaxTermLength, DistributedFacetPivotSmallTest, TestSolrXmlPersistence, DistributedFacetPivotLargeTest, CloudMLTQParserTest, SampleTest, EnumFieldTest, AutoCommitTest, DistributedSuggestComponentTest, PathHierarchyTokenizerFactoryTest, TestJmxIntegration, HdfsDirectoryTest, MBeansHandlerTest, UpdateRequestProcessorFactoryTest, AssignTest, SpellCheckCollatorTest, TestPostingsSolrHighlighter, TermVectorComponentTest, UUIDFieldTest, TestCodecSupport, FieldAnalysisRequestHandlerTest, DateFieldTest, SimpleCollectionCreateDeleteTest, TestBinaryField, TestDynamicLoading, TestOverriddenPrefixQueryForCustomFieldType, TestReplicationHandlerBackup, TestConfigSets, TestSchemaManager, ClusterStateUpdateTest, OverseerCollectionProcessorTest, LeaderFailoverAfterPartitionTest, SharedFSAutoReplicaFailoverUtilsTest, BlockDirectoryTest, MigrateRouteKeyTest, UniqFieldsUpdateProcessorFactoryTest, AsyncMigrateRouteKeyTest, PluginInfoTest, MinimalSchemaTest, DirectUpdateHandlerOptimizeTest, TestFieldSortValues, HighlighterTest, TestFoldingMultitermQuery, DirectSolrSpellCheckerTest, TestExpandComponent, UpdateParamsTest, TestCSVLoader, TestStressReorder, TestLeaderElectionZkExpiry, TestSolrDeletionPolicy2, TestFastLRUCache, TestBulkSchemaAPI, TestLMDirichletSimilarityFactory, TestNRTOpen, StandardRequestHandlerTest, TestSolrDeletionPolicy1, SpellingQueryConverterTest, DistributedFacetPivotSmallAdvancedTest, TestAnalyzeInfixSuggestions, HighlighterConfigTest, TestNonNRTOpen, TestAnalyzedSuggestions, TestCloudInspectUtil, DistributedTermsComponentTest, SOLR749Test, DistanceFunctionTest, TestGroupingSearch, ChaosMonkeySafeLeaderTest, TimeZoneUtilsTest, AnalysisErrorHandlingTest, DeleteInactiveReplicaTest, TestTrie, TestSolrQueryParserDefaultOperatorResource, TestDefaultStatsCache, CoreAdminHandlerTest, TestConfigOverlay, TestStressRecovery, TestReRankQParserPlugin, ZkControllerTest, IndexSchemaRuntimeFieldTest, UUIDUpdateProcessorFallbackTest, TestQuerySenderListener, ParsingFieldUpdateProcessorsTest, TestDistributedGrouping, SolrIndexSplitterTest, TestDefaultSimilarityFactory, TestRangeQuery, DistributedFacetPivotWhiteBoxTest, TestMergePolicyConfig, FullSolrCloudDistribCmdsTest, QueryResultKeyTest, TestCharFilters, StatelessScriptUpdateProcessorFactoryTest, TestSolrDynamicMBean, TestRebalanceLeaders, TestRandomFaceting, BlockCacheTest, PeerSyncTest, TestManagedResource, ConvertedLegacyTest, TestMissingGroups, ExternalCollectionsTest, PrimitiveFieldTypeTest, FieldMutatingUpdateProcessorTest, TestIndexSearcher, RollingRestartTest, TestSystemIdResolver, QueryEqualityTest, SolrTestCaseJ4Test, TestRecoveryHdfs, UnloadDistributedZkTest, TestXIncludeConfig, TestSurroundQueryParser, IndexSchemaTest, NumericFieldsTest, LeaderInitiatedRecoveryOnCommitTest, DebugComponentTest, TestSolrQueryParser, TestReversedWildcardFilterFactory, TestPHPSerializedResponseWriter, BinaryUpdateRequestHandlerTest, DistributedQueueTest, BasicDistributedZkTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest, SyncSliceTest, OpenCloseCoreStressTest, OverseerTest, LeaderElectionIntegrationTest, ShardRoutingTest, BasicZkTest, RecoveryZkTest, TestReplicationHandler, LeaderElectionTest, TestZkChroot, TestRandomDVFaceting, ZkCLITest, ShardRoutingCustomTest, TestHashPartitioner, TermVectorComponentDistributedTest, TestRealTimeGet, TestStressVersions, HardAutoCommitTest, StatsComponentTest, SpellCheckComponentTest, QueryElevationComponentTest, BadIndexSchemaTest, TestFiltering, TestLazyCores, DirectUpdateHandlerTest, TestBadConfig, SoftAutoCommitTest, ShowFileRequestHandlerTest, CurrencyFieldOpenExchangeTest, DistributedQueryElevationComponentTest, CurrencyFieldXmlFileTest, SimplePostToolTest, TestCoreDiscovery, SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, SuggesterFSTTest, SolrRequestParserTest, DocValuesTest, SuggesterTSTTest, SuggesterTest, TestStressLucene, SpatialFilterTest, SuggesterWFSTTest, PolyFieldTest, WordBreakSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, SolrCoreCheckLockOnStartupTest, TestUpdate, TestAtomicUpdateErrorCases, DefaultValueUpdateProcessorTest, SortByFunctionTest, DocValuesMultiTest, XsltUpdateRequestHandlerTest, CacheHeaderTest, DisMaxRequestHandlerTest, TestWriterPerf, TestQueryTypes, TestOmitPositions, XmlUpdateRequestHandlerTest, RequestHandlersTest, DocumentBuilderTest, TestValueSourceCache, MoreLikeThisHandlerTest, RequiredFieldsTest, FastVectorHighlighterTest, LoggingHandlerTest, RegexBoostProcessorTest, SolrPluginUtilsTest, JSONWriterTest, TestCSVResponseWriter, TestPartialUpdateDeduplication, PingRequestHandlerTest, SearchHandlerTest, CoreContainerCoreInitFailuresTest, TestLFUCache, TestSolrIndexConfig, TestQuerySenderNoQuery, ResponseLogComponentTest, SolrIndexConfigTest, BadComponentTest, TestDocSet, TestSearchPerf, TestConfig, ExternalFileFieldSortTest, TestSolrCoreProperties, DirectSolrConnectionTest, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, SpellPossibilityIteratorTest, EchoParamsTest, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMJelinekMercerSimilarityFactory, TestIBSimilarityFactory, TestBM25SimilarityFactory, TestFastWriter, TestJmxMonitoredMap, ResourceLoaderTest, TestFastOutputStream, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, DateMathParserTest, PreAnalyzedFieldTest, TestSuggestSpellingConverter, DOMUtilTest, ClusterStateTest, ZkNodePropsTest, SliceStateTest, FileUtilsTest, CircularListTest, TestRTGBase, CursorPagingTest, TestHighlightDedupGrouping, AliasIntegrationTest, CloudExitableDirectoryReaderTest, CollectionsAPIAsyncDistributedZkTest, ConnectionManagerTest, DeleteReplicaTest]
[junit4] Completed in 34.58s, 1 test, 1 failure <<< FAILURES!
[...truncated 316 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:519: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:467: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:61: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:187: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:510: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1349: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:956: There were test failures: 459 suites, 1856 tests, 1 failure, 37 ignored (21 assumptions)
Total time: 132 minutes 7 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC (asserts: true)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any