You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/10/20 18:51:41 UTC
[JENKINS] Lucene-Solr-4.x-MacOSX (64bit/jdk1.6.0) - Build # 906 -
Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-MacOSX/906/
Java: 64bit/jdk1.6.0 -XX:-UseCompressedOops -XX:+UseParallelGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
collection already exists: awholynewcollection_0
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: collection already exists: awholynewcollection_0
at __randomizedtesting.SeedInfo.seed([46F62D073F63B7D3:C710A31F483CD7EF]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:464)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:268)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:636)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1580)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1542)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1594)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:565)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:193)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:695)
Build Log:
[...truncated 9201 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> 181720 T272 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /ec/ss
[junit4] 2> 181730 T272 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./solrtest-CollectionsAPIDistributedZkTest-1382284695282
[junit4] 2> 181732 T272 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 181733 T273 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 181834 T272 oasc.ZkTestServer.run start zk server on port:51999
[junit4] 2> 181837 T272 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 181846 T279 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12b2bde5 name:ZooKeeperConnection Watcher:127.0.0.1:51999 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 181846 T272 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 181847 T272 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 181872 T272 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 181877 T281 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@276baafc name:ZooKeeperConnection Watcher:127.0.0.1:51999/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 181878 T272 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 181879 T272 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 181894 T272 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 181910 T272 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 181922 T272 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 181937 T272 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 181939 T272 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 181963 T272 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 181965 T272 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 181984 T272 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 181985 T272 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 182002 T272 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 182003 T272 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 182014 T272 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 182015 T272 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 182027 T272 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 182028 T272 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 182042 T272 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 182042 T272 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 182056 T272 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 182057 T272 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 182070 T272 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 182071 T272 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 182082 T272 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 182084 T272 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> Using new style solr.xml
[junit4] 2> 182574 T272 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 182584 T272 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52002
[junit4] 2> 182587 T272 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 182588 T272 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 182588 T272 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1382284695652
[junit4] 2> 182589 T272 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1382284695652/'
[junit4] 2> 182633 T272 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1382284695652/solr.xml
[junit4] 2> 182700 T272 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 182708 T272 oasc.CoreContainer.<init> New CoreContainer 64855122
[junit4] 2> 182709 T272 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1382284695652/]
[junit4] 2> 182711 T272 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 182712 T272 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 182712 T272 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 182713 T272 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 182714 T272 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 182714 T272 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 182715 T272 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 182715 T272 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 182716 T272 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 182722 T272 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 182722 T272 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 182723 T272 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51999/solr
[junit4] 2> 182725 T272 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 182726 T272 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 182733 T292 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2618e905 name:ZooKeeperConnection Watcher:127.0.0.1:51999 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 182736 T272 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 182750 T272 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 182757 T294 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e7b1d52 name:ZooKeeperConnection Watcher:127.0.0.1:51999/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 182758 T272 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 182765 T272 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 182782 T272 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 182801 T272 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 182811 T272 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52002_ec%2Fss
[junit4] 2> 182816 T272 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52002_ec%2Fss
[junit4] 2> 182834 T272 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 182861 T272 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 182873 T272 oasc.Overseer.start Overseer (id=90589409790590979-127.0.0.1:52002_ec%2Fss-n_0000000000) starting
[junit4] 2> 182888 T272 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 182907 T296 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 182909 T272 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 182928 T272 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 182938 T272 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 182958 T295 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 182960 T272 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1382284695652
[junit4] 2> 183112 T272 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1382284695652/conf/
[junit4] 2> 183121 T272 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 183122 T272 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 183123 T272 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 183132 T272 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 183137 T299 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36a0829c name:ZooKeeperConnection Watcher:127.0.0.1:51999/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 183138 T272 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 183144 T272 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 183157 T272 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4] 2> 183672 T272 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 183679 T272 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52006
[junit4] 2> 183682 T272 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 183683 T272 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 183684 T272 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1382284696707
[junit4] 2> 183684 T272 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1382284696707/'
[junit4] 2> 183728 T272 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1382284696707/solr.xml
[junit4] 2> 183793 T272 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 183794 T272 oasc.CoreContainer.<init> New CoreContainer 1912162481
[junit4] 2> 183794 T272 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1382284696707/]
[junit4] 2> 183797 T272 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 183799 T272 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 183800 T272 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 183801 T272 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 183802 T272 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 183803 T272 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 183804 T272 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 183806 T272 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 183807 T272 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 183815 T272 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 183815 T272 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 183816 T272 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51999/solr
[junit4] 2> 183817 T272 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 183819 T272 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 183825 T310 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@251396ec name:ZooKeeperConnection Watcher:127.0.0.1:51999 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 183826 T272 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 183835 T272 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 183840 T312 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@57bdc777 name:ZooKeeperConnection Watcher:127.0.0.1:51999/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 183841 T272 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 183861 T272 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 184880 T272 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52006_ec%2Fss
[junit4] 2> 184884 T272 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52006_ec%2Fss
[junit4] 2> 184901 T299 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 184904 T294 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 184907 T312 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 184930 T272 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1382284696707
[junit4] 2> 185158 T272 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1382284696707/conf/
[junit4] 2> 185171 T272 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 185172 T272 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 185173 T272 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 185639 T272 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 185645 T272 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52009
[junit4] 2> 185647 T272 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 185648 T272 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 185649 T272 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1382284698729
[junit4] 2> 185649 T272 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1382284698729/'
[junit4] 2> 185696 T272 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1382284698729/solr.xml
[junit4] 2> 185761 T272 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 185762 T272 oasc.CoreContainer.<init> New CoreContainer 585795299
[junit4] 2> 185763 T272 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1382284698729/]
[junit4] 2> 185765 T272 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 185765 T272 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 185766 T272 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 185767 T272 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 185768 T272 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 185768 T272 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 185769 T272 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 185770 T272 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 185770 T272 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 185776 T272 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 185777 T272 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 185778 T272 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51999/solr
[junit4] 2> 185779 T272 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 185781 T272 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 185787 T324 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@533db2fd name:ZooKeeperConnection Watcher:127.0.0.1:51999 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 185788 T272 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 185798 T272 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 185804 T326 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d92ce93 name:ZooKeeperConnection Watcher:127.0.0.1:51999/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 185804 T272 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 185824 T272 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 186842 T272 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52009_ec%2Fss
[junit4] 2> 186852 T272 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52009_ec%2Fss
[junit4] 2> 186886 T299 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 186887 T294 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 186888 T326 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 186889 T312 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 186908 T272 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1382284698729
[junit4] 2> 187064 T272 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1382284698729/conf/
[junit4] 2> 187072 T272 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 187074 T272 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 187074 T272 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 187528 T272 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 187537 T272 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52012
[junit4] 2> 187538 T272 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 187538 T272 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 187539 T272 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1382284700630
[junit4] 2> 187539 T272 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1382284700630/'
[junit4] 2> 187579 T272 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1382284700630/solr.xml
[junit4] 2> 187654 T272 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 187655 T272 oasc.CoreContainer.<init> New CoreContainer 1305241482
[junit4] 2> 187656 T272 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1382284700630/]
[junit4] 2> 187657 T272 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 187657 T272 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 187658 T272 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 187658 T272 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 187659 T272 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 187659 T272 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 187661 T272 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 187661 T272 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 187661 T272 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 187667 T272 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 187667 T272 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 187668 T272 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51999/solr
[junit4] 2> 187668 T272 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 187670 T272 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 187676 T338 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@46436cec name:ZooKeeperConnection Watcher:127.0.0.1:51999 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 187678 T272 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 187714 T272 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 187721 T340 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fca022 name:ZooKeeperConnection Watcher:127.0.0.1:51999/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 187721 T272 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 187747 T272 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 188765 T272 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52012_ec%2Fss
[junit4] 2> 188769 T272 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52012_ec%2Fss
[junit4] 2> 188786 T326 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 188788 T312 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 188789 T299 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 188790 T340 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 188790 T294 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 188811 T272 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1382284700630
[junit4] 2> 189035 T272 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1382284700630/conf/
[junit4] 2> 189048 T272 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 189049 T272 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 189050 T272 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 189568 T272 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 189577 T272 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52015
[junit4] 2> 189590 T272 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 189590 T272 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 189591 T272 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1382284702605
[junit4] 2> 189592 T272 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1382284702605/'
[junit4] 2> 189643 T272 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1382284702605/solr.xml
[junit4] 2> 189733 T272 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 189734 T272 oasc.CoreContainer.<init> New CoreContainer 77257350
[junit4] 2> 189735 T272 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1382284702605/]
[junit4] 2> 189739 T272 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 189740 T272 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 189741 T272 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 189741 T272 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 189742 T272 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 189743 T272 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 189744 T272 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 189745 T272 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 189745 T272 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 189754 T272 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 189755 T272 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 189756 T272 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51999/solr
[junit4] 2> 189757 T272 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 189760 T272 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 189766 T352 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@528095c6 name:ZooKeeperConnection Watcher:127.0.0.1:51999 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 189768 T272 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 189780 T272 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 189786 T354 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@39ee475a name:ZooKeeperConnection Watcher:127.0.0.1:51999/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 189787 T272 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 189812 T272 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 190832 T272 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52015_ec%2Fss
[junit4] 2> 190836 T272 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52015_ec%2Fss
[junit4] 2> 190856 T299 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 190857 T312 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 190857 T340 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 190858 T326 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 190858 T354 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 190862 T294 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 190897 T272 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1382284702605
[junit4] 2> 191187 T272 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1382284702605/conf/
[junit4] 2> 191211 T272 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 191214 T272 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 191216 T272 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 191251 T308 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4] 2> 191258 T294 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 191266 T294 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 191272 T296 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "numShards":"2",
[junit4] 2> "name":"nodes_used_collection",
[junit4] 2> "replicationFactor":"2"}
[junit4] 2> 191272 T296 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "numShards":"2",
[junit4] 2> "name":"nodes_used_collection",
[junit4] 2> "replicationFactor":"2"}
[junit4] 2> 192042 T295 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 192046 T295 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: nodes_used_collection
[junit4] 2> 192047 T295 oasc.Overseer$ClusterStateUpdater.createCollection Create collection nodes_used_collection with shards [shard1, shard2]
[junit4] 2> 192073 T340 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 192075 T299 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 192077 T312 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 192079 T326 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 192081 T294 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 192088 T354 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 192197 T296 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2] , repFactor : 2
[junit4] 2> 192198 T296 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica1 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:52009_ec%2Fss
[junit4] 2> 192199 T296 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica2 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:52012_ec%2Fss
[junit4] 2> 192201 T296 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica1 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:52002_ec%2Fss
[junit4] 2> 192212 T296 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica2 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:52006_ec%2Fss
[junit4] 2> 192226 T321 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=down
[junit4] 2> 192230 T305 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=down
[junit4] 2> 192235 T336 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=down
[junit4] 2> 192236 T290 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=down
[junit4] 2> 192238 T321 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 192242 T305 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 192243 T336 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 192244 T290 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 193625 T295 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 193629 T295 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52009/ec/ss",
[junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52009_ec%2Fss",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 193671 T295 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52006/ec/ss",
[junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52006_ec%2Fss",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 193697 T295 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52012/ec/ss",
[junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52012_ec%2Fss",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node3"}
[junit4] 2> 193734 T295 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52002/ec/ss",
[junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52002_ec%2Fss",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node4"}
[junit4] 2> 193770 T340 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 193775 T354 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 193778 T326 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 193781 T299 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 193782 T312 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 193790 T294 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 194241 T321 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for nodes_used_collection_shard1_replica1
[junit4] 2> 194247 T321 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica1' using instanceDir: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1382284698729/nodes_used_collection_shard1_replica1
[junit4] 2> 194248 T321 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4] 2> 194248 T305 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for nodes_used_collection_shard2_replica2
[junit4] 2> 194247 T290 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for nodes_used_collection_shard2_replica1
[junit4] 2> 194254 T305 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica2' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1382284696707/nodes_used_collection_shard2_replica2
[junit4] 2> 194255 T305 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4] 2> 194247 T336 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for nodes_used_collection_shard1_replica2
[junit4] 2> 194256 T290 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica1' using instanceDir: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1382284695652/nodes_used_collection_shard2_replica1
[junit4] 2> 194261 T290 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4] 2> 194262 T321 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4] 2> 194263 T321 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 194262 T336 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica2' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1382284700630/nodes_used_collection_shard1_replica2
[junit4] 2> 194265 T336 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4] 2> 194267 T305 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4] 2> 194268 T305 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 194271 T290 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4] 2> 194272 T290 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 194274 T336 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4] 2> 194275 T336 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 194288 T321 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 194289 T321 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4] 2> 194290 T290 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 194292 T290 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4] 2> 194295 T305 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 194296 T305 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4] 2> 194303 T336 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 194305 T336 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4] 2> 194325 T290 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4] 2> 194326 T321 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4] 2> 194344 T321 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1382284698729/nodes_used_collection_shard1_replica1/'
[junit4] 2> 194351 T336 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4] 2> 194369 T290 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1382284695652/nodes_used_collection_shard2_replica1/'
[junit4] 2> 194395 T305 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4] 2> 194396 T336 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1382284700630/nodes_used_collection_shard1_replica2/'
[junit4] 2> 194410 T305 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1382284696707/nodes_used_collection_shard2_replica2/'
[junit4] 2> 194850 T321 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
[junit4] 2> 194865 T336 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
[junit4] 2> 194869 T305 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
[junit4] 2> 194892 T290 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
[junit4] 2> 195046 T321 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 195062 T321 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 195093 T290 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 195106 T321 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica1] Schema name=test
[junit4] 2> 195118 T336 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 195122 T290 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 195144 T336 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 195175 T305 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 195181 T290 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica1] Schema name=test
[junit4] 2> 195199 T305 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 195216 T336 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica2] Schema name=test
[junit4] 2> 195292 T305 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica2] Schema name=test
[junit4] 2> 197376 T290 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 197381 T290 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 197382 T290 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 197398 T321 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 197399 T321 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 197420 T305 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 197422 T305 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 197423 T336 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 197424 T336 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 197425 T290 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 197425 T321 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 197424 T305 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 197426 T336 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 197440 T305 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 197447 T321 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 197454 T321 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 197459 T305 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 197495 T336 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 197504 T290 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 197559 T336 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 197796 T305 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 197818 T321 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 197833 T321 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 197843 T305 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 197858 T305 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 197915 T305 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 197916 T305 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 197917 T305 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 197921 T321 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 197950 T336 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 197966 T305 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 197968 T305 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 197970 T305 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 197972 T305 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica2] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1382284696707/nodes_used_collection_shard2_replica2/, dataDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1382284696707/nodes_used_collection_shard2_replica2/data/
[junit4] 2> 197973 T305 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@670064a4
[junit4] 2> 197987 T336 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 197992 T321 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 197995 T321 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 197996 T321 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 197989 T305 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1382284696707/nodes_used_collection_shard2_replica2/data
[junit4] 2> 198001 T305 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1382284696707/nodes_used_collection_shard2_replica2/data/index/
[junit4] 2> 198002 T305 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica2] Solr index directory '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1382284696707/nodes_used_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 197989 T290 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 198007 T305 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1382284696707/nodes_used_collection_shard2_replica2/data/index
[junit4] 2> 198011 T305 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=29, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 198022 T336 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 198026 T305 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@6fc62aa8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@36300ca7),segFN=segments_1,generation=1}
[junit4] 2> 198026 T305 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 198042 T290 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 198044 T305 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 198045 T305 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 198050 T321 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 198051 T321 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 198052 T321 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 198053 T321 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica1] Opening new SolrCore at ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1382284698729/nodes_used_collection_shard1_replica1/, dataDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1382284698729/nodes_used_collection_shard1_replica1/data/
[junit4] 2> 198058 T321 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@670064a4
[junit4] 2> 198050 T305 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 198068 T305 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 198079 T305 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 198081 T305 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 198082 T305 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 198083 T305 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 198084 T305 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 198085 T305 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 198087 T305 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 198087 T305 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 198088 T305 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 198089 T305 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 198091 T305 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 198091 T290 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 198068 T336 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 198098 T336 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 198099 T336 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 198068 T321 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1382284698729/nodes_used_collection_shard1_replica1/data
[junit4] 2> 198100 T321 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1382284698729/nodes_used_collection_shard1_replica1/data/index/
[junit4] 2> 198101 T290 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 198102 T290 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 198101 T321 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica1] Solr index directory './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1382284698729/nodes_used_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 198105 T321 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1382284698729/nodes_used_collection_shard1_replica1/data/index
[junit4] 2> 198107 T321 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=29, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 198111 T321 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@42567aef lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@8dfd603),segFN=segments_1,generation=1}
[junit4] 2> 198112 T321 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 198105 T290 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 198118 T336 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 198118 T336 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 198119 T336 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 198121 T336 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica2] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1382284700630/nodes_used_collection_shard1_replica2/, dataDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1382284700630/nodes_used_collection_shard1_replica2/data/
[junit4] 2> 198122 T336 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@670064a4
[junit4] 2> 198125 T336 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1382284700630/nodes_used_collection_shard1_replica2/data
[junit4] 2> 198126 T336 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1382284700630/nodes_used_collection_shard1_replica2/data/index/
[junit4] 2> 198127 T336 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica2] Solr index directory '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1382284700630/nodes_used_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 198127 T305 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 198133 T321 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 198129 T336 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1382284700630/nodes_used_collection_shard1_replica2/data/index
[junit4] 2> 198137 T305 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 198137 T305 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 198137 T336 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=29, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 198149 T305 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=26, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8653585283337627]
[junit4] 2> 198137 T321 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 198153 T321 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 198155 T321 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 198157 T321 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 198158 T321 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 198160 T321 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 198162 T321 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 198163 T321 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 198166 T321 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 198168 T290 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 198168 T290 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 198169 T290 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 198170 T290 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica1] Opening new SolrCore at ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1382284695652/nodes_used_collection_shard2_replica1/, dataDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1382284695652/nodes_used_collection_shard2_replica1/data/
[junit4] 2> 198170 T290 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@670064a4
[junit4] 2> 198173 T290 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1382284695652/nodes_used_collection_shard2_replica1/data
[junit4] 2> 198174 T290 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1382284695652/nodes_used_collection_shard2_replica1/data/index/
[junit4] 2> 198174 T290 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica1] Solr index directory './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1382284695652/nodes_used_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 198175 T290 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1382284695652/nodes_used_collection_shard2_replica1/data/index
[junit4] 2> 198176 T290 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=29, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 198178 T290 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@139a9de2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2b81c482),segFN=segments_1,generation=1}
[junit4] 2> 198179 T290 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 198180 T336 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@5c8aca5e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@60bb94d9),segFN=segments_1,generation=1}
[junit4] 2> 198181 T336 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 198188 T290 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 198189 T290 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 198190 T290 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 198190 T290 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 198191 T290 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 198192 T290 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 198193 T290 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 198193 T290 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 198195 T290 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 198196 T290 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 198198 T290 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 198199 T290 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 198206 T290 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 198207 T290 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 198208 T336 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 198210 T336 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 198211 T336 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 198212 T336 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 198213 T336 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 198215 T336 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 198217 T336 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 198228 T336 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 198229 T336 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 198231 T336 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 198234 T336 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 198237 T336 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 198238 T336 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 198241 T336 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 198168 T321 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 198244 T321 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 198245 T321 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 198249 T321 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 198251 T321 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 198253 T336 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 198258 T336 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 198208 T290 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 198198 T305 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@6fc62aa8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@36300ca7),segFN=segments_1,generation=1}
[junit4] 2> 198277 T305 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 198290 T305 oass.SolrIndexSearcher.<init> Opening Searcher@764dabd7 main
[junit4] 2> 198294 T321 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 198299 T290 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 198306 T336 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 198307 T336 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 198309 T321 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 198310 T321 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 198312 T290 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 198313 T290 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 198314 T360 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica2] Registered new searcher Searcher@764dabd7 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 198315 T290 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=26, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8653585283337627]
[junit4] 2> 198315 T336 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=26, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8653585283337627]
[junit4] 2> 198316 T321 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=26, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8653585283337627]
[junit4] 2> 198320 T336 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@5c8aca5e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@60bb94d9),segFN=segments_1,generation=1}
[junit4] 2> 198321 T336 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 198321 T305 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica2
[junit4] 2> 198322 T305 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica2 address:http://127.0.0.1:52006/ec/ss collection:nodes_used_collection shard:shard2
[junit4] 2> 198321 T290 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@139a9de2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2b81c482),segFN=segments_1,generation=1}
[junit4] 2> 198324 T290 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 198325 T290 oass.SolrIndexSearcher.<init> Opening Searcher@33e1830b main
[junit4] 2> 198322 T336 oass.SolrIndexSearcher.<init> Opening Searcher@770cfd02 main
[junit4] 2> 198321 T321 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@42567aef lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@8dfd603),segFN=segments_1,generation=1}
[junit4] 2> 198329 T321 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 198330 T321 oass.SolrIndexSearcher.<init> Opening Searcher@42fced38 main
[junit4] 2> 198340 T305 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard2/election
[junit4] 2> 198343 T362 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica1] Registered new searcher Searcher@42fced38 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 198360 T363 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica1] Registered new searcher Searcher@33e1830b main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 198366 T321 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica1
[junit4] 2> 198372 T321 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica1 address:http://127.0.0.1:52009/ec/ss collection:nodes_used_collection shard:shard1
[junit4] 2> 198377 T361 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica2] Registered new searcher Searcher@770cfd02 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 198380 T290 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica1
[junit4] 2> 198381 T290 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica1 address:http://127.0.0.1:52002/ec/ss collection:nodes_used_collection shard:shard2
[junit4] 2> 198384 T321 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard1/election
[junit4] 2> 198386 T336 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica2
[junit4] 2> 198389 T336 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica2 address:http://127.0.0.1:52012/ec/ss collection:nodes_used_collection shard:shard1
[junit4] 2> 198398 T336 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard1/election
[junit4] 2> 198400 T290 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard2/election
[junit4] 2> 198484 T305 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 198484 T321 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 198514 T321 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 198515 T321 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 198516 T321 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52009/ec/ss/nodes_used_collection_shard1_replica1/
[junit4] 2> 198517 T321 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica1 url=http://127.0.0.1:52009/ec/ss START replicas=[http://127.0.0.1:52012/ec/ss/nodes_used_collection_shard1_replica2/] nUpdates=100
[junit4] 2> 198518 T321 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica1 url=http://127.0.0.1:52009/ec/ss DONE. We have no versions. sync failed.
[junit4] 2> 198519 T321 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 198515 T305 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 198523 T305 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 198524 T305 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52006/ec/ss/nodes_used_collection_s
[...truncated too long message...]
unit4] 2> 272990 T272 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 272991 T272 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 272992 T272 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 272993 T272 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 272994 T272 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard3_replica2] Closing main searcher on request.
[junit4] 2> 272995 T272 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 272996 T272 oasc.CachingDirectoryFactory.closeCacheValue looking to close ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1382284702605/awholynewcollection_0_shard3_replica2/data/index [CachedDir<<refCount=0;path=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1382284702605/awholynewcollection_0_shard3_replica2/data/index;done=false>>]
[junit4] 2> 272998 T272 oasc.CachingDirectoryFactory.close Closing directory: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1382284702605/awholynewcollection_0_shard3_replica2/data/index
[junit4] 2> 272999 T272 oasc.CachingDirectoryFactory.closeCacheValue looking to close ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1382284702605/awholynewcollection_0_shard3_replica2/data [CachedDir<<refCount=0;path=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1382284702605/awholynewcollection_0_shard3_replica2/data;done=false>>]
[junit4] 2> 272999 T272 oasc.CachingDirectoryFactory.close Closing directory: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1382284702605/awholynewcollection_0_shard3_replica2/data
[junit4] 2> 273000 T272 oasc.SolrCore.close [awholynewcollection_0_shard5_replica2] CLOSING SolrCore org.apache.solr.core.SolrCore@11d1f39a
[junit4] 2> 273016 T272 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 273017 T272 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 273017 T272 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 273018 T272 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 273019 T272 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard5_replica2] Closing main searcher on request.
[junit4] 2> 273020 T272 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 273020 T272 oasc.CachingDirectoryFactory.closeCacheValue looking to close ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1382284702605/awholynewcollection_0_shard5_replica2/data/index [CachedDir<<refCount=0;path=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1382284702605/awholynewcollection_0_shard5_replica2/data/index;done=false>>]
[junit4] 2> 273021 T272 oasc.CachingDirectoryFactory.close Closing directory: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1382284702605/awholynewcollection_0_shard5_replica2/data/index
[junit4] 2> 273021 T272 oasc.CachingDirectoryFactory.closeCacheValue looking to close ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1382284702605/awholynewcollection_0_shard5_replica2/data [CachedDir<<refCount=0;path=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1382284702605/awholynewcollection_0_shard5_replica2/data;done=false>>]
[junit4] 2> 273022 T272 oasc.CachingDirectoryFactory.close Closing directory: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1382284702605/awholynewcollection_0_shard5_replica2/data
[junit4] 2> 273025 T506 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=90589409790590988-127.0.0.1:52015_ec%2Fss-n_0000000004) am no longer a leader.
[junit4] 2> 273050 T272 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/ec/ss,null}
[junit4] 2> 273112 T272 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> 273122 T272 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:51999 51999
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=46F62D073F63B7D3 -Dtests.slow=true -Dtests.locale=no -Dtests.timezone=Asia/Chongqing -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 91.6s | CollectionsAPIDistributedZkTest.testDistribSearch <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: collection already exists: awholynewcollection_0
[junit4] > at __randomizedtesting.SeedInfo.seed([46F62D073F63B7D3:C710A31F483CD7EF]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:464)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:268)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:636)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1580)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1542)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1594)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:565)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:193)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4] > at java.lang.Thread.run(Thread.java:695)
[junit4] 2> 273312 T272 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 91603 T271 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> 274534 T354 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Asserting, sim=DefaultSimilarity, locale=no, timezone=Asia/Chongqing
[junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Apple Inc. 1.6.0_65 (64-bit)/cpus=2,threads=1,free=124022032,total=261357568
[junit4] 2> NOTE: All tests run in this JVM: [TestClassNameShortening, TestReversedWildcardFilterFactory, HdfsBasicDistributedZk2Test, TestReload, TestCodecSupport, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest]
[junit4] Completed in 92.93s, 1 test, 1 error <<< FAILURES!
[...truncated 992 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:428: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:408: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build.xml:189: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/common-build.xml:483: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:1263: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:906: There were test failures: 327 suites, 1453 tests, 1 error, 40 ignored (5 assumptions)
Total time: 101 minutes 49 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.6.0 -XX:-UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-MacOSX (64bit/jdk1.7.0) - Build # 907 -
Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-MacOSX/907/
Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseSerialGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:53365/ui_s/collection1, http://127.0.0.1:53324/ui_s/collection1, http://127.0.0.1:53331/ui_s/collection1, http://127.0.0.1:53317/ui_s/collection1, http://127.0.0.1:53314/ui_s/collection1, http://127.0.0.1:53311/ui_s/collection1, http://127.0.0.1:53350/ui_s/collection1, http://127.0.0.1:53355/ui_s/collection1, http://127.0.0.1:53338/ui_s/collection1, http://127.0.0.1:53320/ui_s/collection1, http://127.0.0.1:53360/ui_s/collection1, http://127.0.0.1:53345/ui_s/collection1]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:53365/ui_s/collection1, http://127.0.0.1:53324/ui_s/collection1, http://127.0.0.1:53331/ui_s/collection1, http://127.0.0.1:53317/ui_s/collection1, http://127.0.0.1:53314/ui_s/collection1, http://127.0.0.1:53311/ui_s/collection1, http://127.0.0.1:53350/ui_s/collection1, http://127.0.0.1:53355/ui_s/collection1, http://127.0.0.1:53338/ui_s/collection1, http://127.0.0.1:53320/ui_s/collection1, http://127.0.0.1:53360/ui_s/collection1, http://127.0.0.1:53345/ui_s/collection1]
at __randomizedtesting.SeedInfo.seed([79D554505CB7677B:F833DA482BE80747]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:337)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:636)
at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1140)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:138)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:53338/ui_s/collection1
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:476)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:268)
... 46 more
Caused by: java.net.SocketException: Invalid argument
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:152)
at java.net.SocketInputStream.read(SocketInputStream.java:122)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:166)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:90)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:281)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:92)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:61)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:254)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:289)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:252)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:191)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:300)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:127)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:715)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:520)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:366)
... 48 more
Build Log:
[...truncated 10246 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> 1803402 T4362 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /ui_s/
[junit4] 2> 1803413 T4362 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeySafeLeaderTest-1382314324510
[junit4] 2> 1803415 T4362 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1803416 T4363 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1803523 T4362 oasc.ZkTestServer.run start zk server on port:53304
[junit4] 2> 1803526 T4362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1803541 T4369 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e86a9dd name:ZooKeeperConnection Watcher:127.0.0.1:53304 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1803542 T4362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1803542 T4362 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1803556 T4362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1803565 T4371 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f6baf11 name:ZooKeeperConnection Watcher:127.0.0.1:53304/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1803566 T4362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1803568 T4362 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1803575 T4362 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1803583 T4362 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1803589 T4362 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1803596 T4362 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1803598 T4362 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1803611 T4362 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1803612 T4362 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1803621 T4362 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1803622 T4362 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1803630 T4362 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1803631 T4362 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1803640 T4362 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1803641 T4362 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1803650 T4362 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1803651 T4362 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1803658 T4362 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1803659 T4362 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1803667 T4362 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1803668 T4362 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1803676 T4362 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1803677 T4362 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1803689 T4362 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1803690 T4362 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1804129 T4362 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1804136 T4362 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53307
[junit4] 2> 1804139 T4362 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1804139 T4362 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1804140 T4362 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1382314324793
[junit4] 2> 1804142 T4362 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1382314324793/'
[junit4] 2> 1804184 T4362 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1382314324793/solr.xml
[junit4] 2> 1804297 T4362 oasc.CoreContainer.<init> New CoreContainer 1257947028
[junit4] 2> 1804298 T4362 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1382314324793/]
[junit4] 2> 1804300 T4362 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 1804300 T4362 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1804301 T4362 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1804301 T4362 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1804302 T4362 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1804302 T4362 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1804302 T4362 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1804303 T4362 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1804303 T4362 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1804309 T4362 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1804310 T4362 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1804311 T4362 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53304/solr
[junit4] 2> 1804311 T4362 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1804313 T4362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1804317 T4382 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32b77be1 name:ZooKeeperConnection Watcher:127.0.0.1:53304 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1804318 T4362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1804324 T4362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1804328 T4384 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@58485703 name:ZooKeeperConnection Watcher:127.0.0.1:53304/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1804329 T4362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1804333 T4362 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1804341 T4362 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1804349 T4362 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1804354 T4362 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53307_ui_s
[junit4] 2> 1804356 T4362 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53307_ui_s
[junit4] 2> 1804364 T4362 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1804377 T4362 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1804383 T4362 oasc.Overseer.start Overseer (id=90591351571677187-127.0.0.1:53307_ui_s-n_0000000000) starting
[junit4] 2> 1804391 T4362 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1804401 T4386 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1804403 T4362 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1804408 T4362 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1804413 T4362 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1804420 T4385 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1804432 T4387 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1804432 T4387 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1804435 T4387 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1805938 T4385 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1805942 T4385 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:53307/ui_s",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53307_ui_s",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1805943 T4385 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 1805945 T4385 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1805971 T4384 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1806437 T4387 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1806439 T4387 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1382314324793/collection1
[junit4] 2> 1806440 T4387 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1806443 T4387 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1806444 T4387 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1806450 T4387 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1382314324793/collection1/'
[junit4] 2> 1806455 T4387 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1382314324793/collection1/lib/classes/' to classloader
[junit4] 2> 1806457 T4387 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1382314324793/collection1/lib/README' to classloader
[junit4] 2> 1806582 T4387 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
[junit4] 2> 1806671 T4387 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1806675 T4387 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1806689 T4387 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1807612 T4387 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 1807613 T4387 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 1807614 T4387 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1807628 T4387 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1807635 T4387 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1807665 T4387 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1807670 T4387 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1807676 T4387 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1807678 T4387 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1807678 T4387 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1807679 T4387 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1807681 T4387 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1807681 T4387 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1807682 T4387 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1807682 T4387 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1382314324793/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/control/data/
[junit4] 2> 1807682 T4387 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@151418b5
[junit4] 2> 1807684 T4387 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/control/data
[junit4] 2> 1807685 T4387 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/control/data/index/
[junit4] 2> 1807685 T4387 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 1807686 T4387 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/control/data/index
[junit4] 2> 1807687 T4387 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=40.333984375, floorSegmentMB=1.73828125, forceMergeDeletesPctAllowed=3.0920996602059603, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1807692 T4387 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1807692 T4387 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1807697 T4387 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1807698 T4387 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1807699 T4387 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1807699 T4387 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1807699 T4387 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1807700 T4387 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1807701 T4387 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1807701 T4387 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1807702 T4387 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1807702 T4387 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1807703 T4387 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1807703 T4387 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1807704 T4387 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1807705 T4387 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1807705 T4387 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1807720 T4387 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1807725 T4387 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1807725 T4387 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1807726 T4387 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=79.3193359375, floorSegmentMB=2.1640625, forceMergeDeletesPctAllowed=14.853468200392463, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4683090916439746
[junit4] 2> 1807728 T4387 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1807729 T4387 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1807729 T4387 oass.SolrIndexSearcher.<init> Opening Searcher@3b22ef96 main
[junit4] 2> 1807733 T4388 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3b22ef96 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1807736 T4387 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1807736 T4387 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53307/ui_s collection:control_collection shard:shard1
[junit4] 2> 1807739 T4387 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1807755 T4387 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1807760 T4387 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1807761 T4387 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 1807761 T4387 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53307/ui_s/collection1/
[junit4] 2> 1807761 T4387 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1807762 T4387 oasc.SyncStrategy.syncToMe http://127.0.0.1:53307/ui_s/collection1/ has no replicas
[junit4] 2> 1807762 T4387 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53307/ui_s/collection1/ shard1
[junit4] 2> 1807762 T4387 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1808997 T4385 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1809037 T4384 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1809077 T4387 oasc.ZkController.register We are http://127.0.0.1:53307/ui_s/collection1/ and leader is http://127.0.0.1:53307/ui_s/collection1/
[junit4] 2> 1809078 T4387 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53307/ui_s
[junit4] 2> 1809079 T4387 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1809079 T4387 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1809080 T4387 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1809083 T4387 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1809086 T4362 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1809086 T4362 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1809090 T4362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1809095 T4391 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5f91810 name:ZooKeeperConnection Watcher:127.0.0.1:53304/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1809095 T4362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1809098 T4362 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1809103 T4362 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4] 2> 1809541 T4362 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1809548 T4362 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53311
[junit4] 2> 1809549 T4362 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1809550 T4362 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1809551 T4362 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1382314330198
[junit4] 2> 1809551 T4362 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1382314330198/'
[junit4] 2> 1809594 T4362 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1382314330198/solr.xml
[junit4] 2> 1809716 T4362 oasc.CoreContainer.<init> New CoreContainer 1657369839
[junit4] 2> 1809717 T4362 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1382314330198/]
[junit4] 2> 1809724 T4362 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 1809724 T4362 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1809725 T4362 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1809726 T4362 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1809726 T4362 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1809727 T4362 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1809728 T4362 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1809728 T4362 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1809729 T4362 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1809737 T4362 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1809737 T4362 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1809738 T4362 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53304/solr
[junit4] 2> 1809739 T4362 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1809740 T4362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1809746 T4402 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18d28bb6 name:ZooKeeperConnection Watcher:127.0.0.1:53304 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1809747 T4362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1809754 T4362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1809762 T4404 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@211fff53 name:ZooKeeperConnection Watcher:127.0.0.1:53304/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1809763 T4362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1809772 T4362 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1810574 T4385 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1810578 T4385 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:53307/ui_s",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53307_ui_s",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1810596 T4391 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1810597 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1810597 T4384 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1810783 T4362 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53311_ui_s
[junit4] 2> 1810788 T4362 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53311_ui_s
[junit4] 2> 1810800 T4384 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1810801 T4404 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1810801 T4391 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1810818 T4405 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1810818 T4405 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1810821 T4405 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1812119 T4385 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1812123 T4385 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:53311/ui_s",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53311_ui_s",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1812124 T4385 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 1812125 T4385 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1812146 T4384 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1812146 T4391 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1812146 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1812825 T4405 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1812825 T4405 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1382314330198/collection1
[junit4] 2> 1812826 T4405 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1812828 T4405 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1812829 T4405 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1812834 T4405 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1382314330198/collection1/'
[junit4] 2> 1812838 T4405 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1382314330198/collection1/lib/classes/' to classloader
[junit4] 2> 1812840 T4405 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1382314330198/collection1/lib/README' to classloader
[junit4] 2> 1812943 T4405 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
[junit4] 2> 1813042 T4405 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1813046 T4405 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1813058 T4405 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1813930 T4405 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 1813932 T4405 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 1813933 T4405 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1813948 T4405 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1813953 T4405 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1813985 T4405 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1813992 T4405 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1813999 T4405 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1814001 T4405 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1814002 T4405 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1814002 T4405 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1814005 T4405 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1814005 T4405 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1814006 T4405 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1814006 T4405 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1382314330198/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/jetty1/
[junit4] 2> 1814007 T4405 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@151418b5
[junit4] 2> 1814008 T4405 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/jetty1
[junit4] 2> 1814009 T4405 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/jetty1/index/
[junit4] 2> 1814010 T4405 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 1814010 T4405 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/jetty1/index
[junit4] 2> 1814011 T4405 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=40.333984375, floorSegmentMB=1.73828125, forceMergeDeletesPctAllowed=3.0920996602059603, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1814016 T4405 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 1814016 T4405 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1814023 T4405 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1814024 T4405 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1814024 T4405 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1814025 T4405 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1814025 T4405 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1814025 T4405 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1814026 T4405 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1814027 T4405 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1814027 T4405 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1814028 T4405 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1814029 T4405 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1814029 T4405 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1814030 T4405 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1814030 T4405 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1814031 T4405 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1814045 T4405 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1814051 T4405 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1814051 T4405 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1814053 T4405 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=79.3193359375, floorSegmentMB=2.1640625, forceMergeDeletesPctAllowed=14.853468200392463, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4683090916439746
[junit4] 2> 1814056 T4405 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 1814056 T4405 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1814057 T4405 oass.SolrIndexSearcher.<init> Opening Searcher@4c941c4f main
[junit4] 2> 1814077 T4406 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4c941c4f main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1814079 T4405 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1814079 T4405 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53311/ui_s collection:collection1 shard:shard1
[junit4] 2> 1814082 T4405 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1814104 T4405 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1814111 T4405 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1814111 T4405 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 1814112 T4405 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53311/ui_s/collection1/
[junit4] 2> 1814112 T4405 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1814113 T4405 oasc.SyncStrategy.syncToMe http://127.0.0.1:53311/ui_s/collection1/ has no replicas
[junit4] 2> 1814113 T4405 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53311/ui_s/collection1/ shard1
[junit4] 2> 1814113 T4405 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1815177 T4385 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1815214 T4384 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1815214 T4391 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1815215 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1815248 T4405 oasc.ZkController.register We are http://127.0.0.1:53311/ui_s/collection1/ and leader is http://127.0.0.1:53311/ui_s/collection1/
[junit4] 2> 1815249 T4405 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53311/ui_s
[junit4] 2> 1815250 T4405 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1815251 T4405 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1815252 T4405 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1815261 T4405 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1815268 T4362 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1815269 T4362 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1815730 T4362 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1815734 T4362 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53314
[junit4] 2> 1815736 T4362 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1815736 T4362 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1815737 T4362 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1382314336369
[junit4] 2> 1815737 T4362 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1382314336369/'
[junit4] 2> 1815775 T4362 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1382314336369/solr.xml
[junit4] 2> 1815883 T4362 oasc.CoreContainer.<init> New CoreContainer 204151839
[junit4] 2> 1815883 T4362 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1382314336369/]
[junit4] 2> 1815886 T4362 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 1815886 T4362 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1815888 T4362 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1815888 T4362 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1815889 T4362 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1815889 T4362 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1815890 T4362 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1815890 T4362 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1815890 T4362 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1815896 T4362 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1815896 T4362 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1815897 T4362 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53304/solr
[junit4] 2> 1815897 T4362 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1815899 T4362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1815903 T4418 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@aca756f name:ZooKeeperConnection Watcher:127.0.0.1:53304 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1815905 T4362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1815910 T4362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1815914 T4420 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e1ddfa0 name:ZooKeeperConnection Watcher:127.0.0.1:53304/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1815915 T4362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1815923 T4362 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1816754 T4385 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1816757 T4385 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:53311/ui_s",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53311_ui_s",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1816778 T4384 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1816780 T4420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1816779 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1816779 T4391 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1816934 T4362 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53314_ui_s
[junit4] 2> 1816939 T4362 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53314_ui_s
[junit4] 2> 1816955 T4420 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1816957 T4384 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1816957 T4391 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1816958 T4404 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1816989 T4421 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1816989 T4421 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1816992 T4421 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1818308 T4385 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1818312 T4385 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:53314/ui_s",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53314_ui_s",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 1818313 T4385 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1818314 T4385 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 1818337 T4384 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1818338 T4391 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1818340 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1818338 T4420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1818997 T4421 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1818998 T4421 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1382314336369/collection1
[junit4] 2> 1818999 T4421 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1819003 T4421 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1819003 T4421 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1819009 T4421 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1382314336369/collection1/'
[junit4] 2> 1819013 T4421 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1382314336369/collection1/lib/classes/' to classloader
[junit4] 2> 1819015 T4421 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1382314336369/collection1/lib/README' to classloader
[junit4] 2> 1819165 T4421 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
[junit4] 2> 1819254 T4421 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1819258 T4421 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1819271 T4421 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1820150 T4421 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 1820151 T4421 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 1820152 T4421 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1820164 T4421 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1820169 T4421 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1820204 T4421 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1820212 T4421 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1820220 T4421 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1820222 T4421 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1820223 T4421 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1820223 T4421 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1820226 T4421 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1820226 T4421 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1820227 T4421 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1820227 T4421 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1382314336369/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/jetty2/
[junit4] 2> 1820227 T4421 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@151418b5
[junit4] 2> 1820229 T4421 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/jetty2
[junit4] 2> 1820230 T4421 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/jetty2/index/
[junit4] 2> 1820231 T4421 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 1820232 T4421 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/jetty2/index
[junit4] 2> 1820233 T4421 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=40.333984375, floorSegmentMB=1.73828125, forceMergeDeletesPctAllowed=3.0920996602059603, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1820237 T4421 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 1820237 T4421 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1820244 T4421 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1820245 T4421 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1820246 T4421 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1820246 T4421 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1820247 T4421 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1820247 T4421 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1820248 T4421 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1820249 T4421 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1820249 T4421 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1820251 T4421 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1820252 T4421 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1820252 T4421 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1820253 T4421 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1820254 T4421 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1820255 T4421 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1820269 T4421 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1820274 T4421 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1820274 T4421 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1820276 T4421 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=79.3193359375, floorSegmentMB=2.1640625, forceMergeDeletesPctAllowed=14.853468200392463, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4683090916439746
[junit4] 2> 1820279 T4421 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 1820279 T4421 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1820279 T4421 oass.SolrIndexSearcher.<init> Opening Searcher@49e3c6d main
[junit4] 2> 1820286 T4422 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@49e3c6d main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1820289 T4421 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1820289 T4421 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53314/ui_s collection:collection1 shard:shard2
[junit4] 2> 1820291 T4421 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 1820307 T4421 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 1820314 T4421 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1820314 T4421 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 1820314 T4421 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53314/ui_s/collection1/
[junit4] 2> 1820315 T4421 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1820315 T4421 oasc.SyncStrategy.syncToMe http://127.0.0.1:53314/ui_s/collection1/ has no replicas
[junit4] 2> 1820315 T4421 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53314/ui_s/collection1/ shard2
[junit4] 2> 1820315 T4421 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 1821373 T4385 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1821416 T4384 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1821417 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1821416 T4391 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1821418 T4420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1821466 T4421 oasc.ZkController.register We are http://127.0.0.1:53314/ui_s/collection1/ and leader is http://127.0.0.1:53314/ui_s/collection1/
[junit4] 2> 1821466 T4421 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53314/ui_s
[junit4] 2> 1821467 T4421 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1821467 T4421 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1821468 T4421 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1821473 T4421 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1821481 T4362 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1821482 T4362 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1821926 T4362 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1821931 T4362 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53317
[junit4] 2> 1821932 T4362 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1821933 T4362 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1821933 T4362 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1382314342580
[junit4] 2> 1821933 T4362 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1382314342580/'
[junit4] 2> 1821969 T4362 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1382314342580/solr.xml
[junit4] 2> 1822092 T4362 oasc.CoreContainer.<init> New CoreContainer 519329327
[junit4] 2> 1822093 T4362 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1382314342580/]
[junit4] 2> 1822095 T4362 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 1822095 T4362 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1822096 T4362 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1822096 T4362 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1822096 T4362 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1822097 T4362 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1822097 T4362 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1822098 T4362 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1822098 T4362 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1822104 T4362 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1822105 T4362 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1822105 T4362 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53304/solr
[junit4] 2> 1822106 T4362 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1822107 T4362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1822113 T4434 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a014d9a name:ZooKeeperConnection Watcher:127.0.0.1:53304 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1822114 T4362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1822120 T4362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1822126 T4436 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@72544084 name:ZooKeeperConnection Watcher:127.0.0.1:53304/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1822126 T4362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1822136 T4362 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1822948 T4385 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1822952 T4385 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:53314/ui_s",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53314_ui_s",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 1822967 T4384 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1822967 T4436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1822968 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1822969 T4420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1822968 T4391 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1823146 T4362 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53317_ui_s
[junit4] 2> 1823149 T4362 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53317_ui_s
[junit4] 2> 1823157 T4436 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1823158 T4384 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1823158 T4391 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1823158 T4420 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1823158 T4404 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1823178 T4437 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1823179 T4437 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1823183 T4437 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1824486 T4385 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1824489 T4385 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:53317/ui_s",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53317_ui_s",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node3"}
[junit4] 2> 1824490 T4385 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1824491 T4385 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 1824503 T4384 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1824503 T4391 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1824504 T4436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1824505 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1824504 T4420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1825187 T4437 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1825187 T4437 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1382314342580/collection1
[junit4] 2> 1825188 T4437 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1825190 T4437 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1825190 T4437 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1825193 T4437 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1382314342580/collection1/'
[junit4] 2> 1825196 T4437 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1382314342580/collection1/lib/classes/' to classloader
[junit4] 2> 1825197 T4437 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1382314342580/collection1/lib/README' to classloader
[junit4] 2> 1825274 T4437 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
[junit4] 2> 1825375 T4437 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1825378 T4437 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1825393 T4437 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1826271 T4437 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 1826273 T4437 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 1826274 T4437 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1826286 T4437 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1826290 T4437 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1826320 T4437 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1826328 T4437 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1826336 T4437 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1826338 T4437 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1826339 T4437 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1826339 T4437 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1826342 T4437 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1826342 T4437 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1826343 T4437 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1826344 T4437 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1382314342580/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/jetty3/
[junit4] 2> 1826344 T4437 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@151418b5
[junit4] 2> 1826345 T4437 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/jetty3
[junit4] 2> 1826346 T4437 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/jetty3/index/
[junit4] 2> 1826347 T4437 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/jetty3/index' doesn't exist. Creating new index...
[junit4] 2> 1826348 T4437 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/jetty3/index
[junit4] 2> 1826348 T4437 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=40.333984375, floorSegmentMB=1.73828125, forceMergeDeletesPctAllowed=3.0920996602059603, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1826353 T4437 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1382314324509/jetty3/index,segFN=segments_1,generation=1}
[junit4] 2> 1826354 T4437 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1826360 T4437 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1826361 T4437 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1826362 T4437 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1826362 T4437 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1826363 T4437 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1826364 T4437 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1826365 T4437 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1826366 T4437 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1826366 T4437 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1826369 T4437 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1826370 T4437 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1826370 T4437 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1826371 T4437 oasc.RequestHandler
[...truncated too long message...]
3355/ui_s/collection1, http://127.0.0.1:53338/ui_s/collection1, http://127.0.0.1:53320/ui_s/collection1, http://127.0.0.1:53360/ui_s/collection1, http://127.0.0.1:53345/ui_s/collection1]
[junit4] > at __randomizedtesting.SeedInfo.seed([79D554505CB7677B:F833DA482BE80747]:0)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:337)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:636)
[junit4] > at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
[junit4] > at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1140)
[junit4] > at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:138)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4] > at java.lang.Thread.run(Thread.java:744)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:53338/ui_s/collection1
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:476)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:268)
[junit4] > ... 46 more
[junit4] > Caused by: java.net.SocketException: Invalid argument
[junit4] > at java.net.SocketInputStream.socketRead0(Native Method)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:152)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:122)
[junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:166)
[junit4] > at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:90)
[junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:281)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:92)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:61)
[junit4] > at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:254)
[junit4] > at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:289)
[junit4] > at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:252)
[junit4] > at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:191)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:300)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:127)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:715)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:520)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:366)
[junit4] > ... 48 more
[junit4] 2> 1923647 T4362 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 120250 T4361 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> 1924290 T4595 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Lucene45: {range_facet_l=PostingsFormat(name=Lucene41WithOrds), text=PostingsFormat(name=Memory doPackFST= true), _version_=PostingsFormat(name=TestBloomFilteredLucene41Postings), rnd_b=Lucene41(blocksize=128), intDefault=PostingsFormat(name=TestBloomFilteredLucene41Postings), timestamp=PostingsFormat(name=Lucene41WithOrds), id=Lucene41(blocksize=128), a_t=PostingsFormat(name=Lucene41WithOrds), range_facet_sl=Lucene41(blocksize=128), range_facet_si=PostingsFormat(name=Lucene41WithOrds), other_tl1=PostingsFormat(name=TestBloomFilteredLucene41Postings), multiDefault=PostingsFormat(name=Lucene41WithOrds), a_si=PostingsFormat(name=TestBloomFilteredLucene41Postings)}, docValues:{}, sim=DefaultSimilarity, locale=no_NO_NY, timezone=America/Argentina/Mendoza
[junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.7.0_45 (64-bit)/cpus=2,threads=1,free=106621504,total=238419968
[junit4] 2> NOTE: All tests run in this JVM: [TestRemoteStreaming, TestCoreContainer, BlockCacheTest, RegexBoostProcessorTest, SchemaVersionSpecificBehaviorTest, HdfsUnloadDistributedZkTest, TestSolrIndexConfig, QueryEqualityTest, JsonLoaderTest, TestSolrDeletionPolicy2, TestReloadAndDeleteDocs, TermVectorComponentTest, TestCloudManagedSchemaAddField, TestManagedSchema, EchoParamsTest, BasicDistributedZkTest, CollectionsAPIDistributedZkTest, TestSweetSpotSimilarityFactory, TestLFUCache, ParsingFieldUpdateProcessorsTest, SimplePostToolTest, HardAutoCommitTest, ZkSolrClientTest, SolrCoreCheckLockOnStartupTest, TestCloudManagedSchema, TestJmxMonitoredMap, PreAnalyzedUpdateProcessorTest, TestPhraseSuggestions, TestDistributedSearch, ResponseLogComponentTest, XmlUpdateRequestHandlerTest, PolyFieldTest, TestIndexSearcher, SliceStateTest, NotRequiredUniqueKeyTest, DebugComponentTest, DocValuesTest, NoCacheHeaderTest, TestAnalyzedSuggestions, TestRTGBase, TestAtomicUpdateErrorCases, TestSolrQueryParserDefaultOperatorResource, TimeZoneUtilsTest, TestDocSet, TestStressRecovery, MBeansHandlerTest, PreAnalyzedFieldTest, TestSchemaVersionResource, TestPostingsSolrHighlighter, ShardSplitTest, AliasIntegrationTest, TestUtils, TestStressReorder, TestDynamicFieldCollectionResource, BasicDistributedZk2Test, TestSystemIdResolver, TestSolrCoreProperties, HdfsSyncSliceTest, TestDocumentBuilder, TestClassNameShortening, HighlighterTest, SolrIndexSplitterTest, LeaderElectionTest, ZkCLITest, MinimalSchemaTest, LukeRequestHandlerTest, ShardRoutingCustomTest, TestJmxIntegration, ClusterStateUpdateTest, SOLR749Test, QueryParsingTest, CachingDirectoryFactoryTest, FileBasedSpellCheckerTest, ScriptEngineTest, DistanceFunctionTest, OpenCloseCoreStressTest, PluginInfoTest, URLClassifyProcessorTest, TestPHPSerializedResponseWriter, TestCopyFieldCollectionResource, BadCopyFieldTest, CircularListTest, TestValueSourceCache, TestPerFieldSimilarity, SuggesterFSTTest, TestSolrQueryParser, UpdateParamsTest, TestCollationField, HdfsLockFactoryTest, TestCoreDiscovery, TestBM25SimilarityFactory, PeerSyncTest, TestConfig, TestNoOpRegenerator, TestZkChroot, ZkNodePropsTest, SolrXmlInZkTest, TestNumberUtils, TestCharFilters, DistributedSpellCheckComponentTest, PrimitiveFieldTypeTest, BJQParserTest, FieldMutatingUpdateProcessorTest, TestUpdate, DirectUpdateHandlerOptimizeTest, TestFunctionQuery, TestInfoStreamLogging, NumericFieldsTest, TestQueryUtils, DocValuesMultiTest, CSVRequestHandlerTest, TestMergePolicyConfig, OverseerTest, ShardRoutingTest, TestAnalyzeInfixSuggestions, AssignTest, BlockDirectoryTest, TestFieldTypeCollectionResource, TestCodecSupport, TestUniqueKeyFieldResource, TestLRUCache, SearchHandlerTest, DateFieldTest, BadIndexSchemaTest, TestSolrJ, InfoHandlerTest, HdfsChaosMonkeySafeLeaderTest, TestWriterPerf, TestRandomMergePolicy, TestComponentsName, UpdateRequestProcessorFactoryTest, TestLMDirichletSimilarityFactory, TestPseudoReturnFields, TestFieldResource, BadComponentTest, DefaultValueUpdateProcessorTest, TestShardHandlerFactory, TestCSVLoader, TestBinaryField, DateMathParserTest, SolrIndexConfigTest, TestDefaultSearchFieldResource, CoreAdminHandlerTest, SolrTestCaseJ4Test, SystemInfoHandlerTest, TestNRTOpen, TestCollationKeyRangeQueries, FieldAnalysisRequestHandlerTest, SpellingQueryConverterTest, HdfsBasicDistributedZkTest, DistributedQueryElevationComponentTest, TestMultiCoreConfBootstrap, SolrCoreTest, TestStressLucene, DocValuesMissingTest, HdfsBasicDistributedZk2Test, ChaosMonkeySafeLeaderTest]
[junit4] Completed in 121.05s, 1 test, 1 error <<< FAILURES!
[...truncated 505 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:428: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:408: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build.xml:189: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/common-build.xml:483: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:1263: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:906: There were test failures: 327 suites, 1453 tests, 1 error, 40 ignored (5 assumptions)
Total time: 106 minutes 49 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure