You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/07/16 18:47:39 UTC
[JENKINS] Lucene-Solr-4.x-MacOSX (64bit/jdk1.7.0) - Build # 635 -
Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-MacOSX/635/
Java: 64bit/jdk1.7.0 -XX:+UseCompressedOops -XX:+UseG1GC
1 tests failed.
REGRESSION: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
collection already exists: awholynewcollection_0
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: collection already exists: awholynewcollection_0
at __randomizedtesting.SeedInfo.seed([B9DD77B346ADE236:383BF9AB31F2820A]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:424)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:264)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:318)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1522)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:438)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
Build Log:
[...truncated 9852 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> 2494874 T5114 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /dx_sd/
[junit4] 2> 2494880 T5114 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./solrtest-CollectionsAPIDistributedZkTest-1373991680037
[junit4] 2> 2494882 T5114 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 2494883 T5115 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2494985 T5114 oasc.ZkTestServer.run start zk server on port:53560
[junit4] 2> 2494987 T5114 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2494998 T5121 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3adf8f27 name:ZooKeeperConnection Watcher:127.0.0.1:53560 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2494999 T5114 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2495000 T5114 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2495007 T5114 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2495013 T5123 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75401615 name:ZooKeeperConnection Watcher:127.0.0.1:53560/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2495013 T5114 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2495014 T5114 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 2495021 T5114 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 2495027 T5114 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 2495033 T5114 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 2495044 T5114 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2495046 T5114 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 2495060 T5114 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 2495061 T5114 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 2495069 T5114 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2495070 T5114 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 2495077 T5114 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2495078 T5114 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 2495085 T5114 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2495086 T5114 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 2495093 T5114 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2495094 T5114 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 2495106 T5114 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2495107 T5114 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2495115 T5114 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2495116 T5114 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 2495126 T5114 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2495127 T5114 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 2495654 T5114 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2495665 T5114 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53563
[junit4] 2> 2495666 T5114 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2495667 T5114 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2495667 T5114 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293
[junit4] 2> 2495668 T5114 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/'
[junit4] 2> 2495724 T5114 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/solr.xml
[junit4] 2> 2495856 T5114 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 2495857 T5114 oasc.CoreContainer.<init> New CoreContainer 59385804
[junit4] 2> 2495858 T5114 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/]
[junit4] 2> 2495861 T5114 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 2495861 T5114 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2495862 T5114 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2495862 T5114 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2495863 T5114 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2495863 T5114 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2495864 T5114 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2495865 T5114 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2495865 T5114 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2495866 T5114 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 2495888 T5114 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2495889 T5114 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53560/solr
[junit4] 2> 2495890 T5114 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2495893 T5114 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2495897 T5134 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48597e11 name:ZooKeeperConnection Watcher:127.0.0.1:53560 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2495898 T5114 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2495902 T5114 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 2495929 T5114 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2495934 T5136 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17133572 name:ZooKeeperConnection Watcher:127.0.0.1:53560/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2495934 T5114 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2495938 T5114 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2495951 T5114 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2495958 T5114 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2495963 T5114 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53563_dx_sd
[junit4] 2> 2495965 T5114 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53563_dx_sd
[junit4] 2> 2495973 T5114 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2495991 T5114 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2495999 T5114 oasc.Overseer.start Overseer (id=90045918743494659-127.0.0.1:53563_dx_sd-n_0000000000) starting
[junit4] 2> 2496010 T5114 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2496021 T5138 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2496023 T5137 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2496029 T5114 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2496036 T5114 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2496040 T5114 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2496051 T5114 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293
[junit4] 2> 2496241 T5114 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/conf/
[junit4] 2> 2496249 T5114 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 2496251 T5114 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2496252 T5114 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2496253 T5114 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2496288 T5114 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4] 2> 2496292 T5114 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2496295 T5141 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4351e546 name:ZooKeeperConnection Watcher:127.0.0.1:53560/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2496295 T5114 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2496298 T5114 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2496305 T5114 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4] 2> 2496773 T5114 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2496782 T5114 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53567
[junit4] 2> 2496783 T5114 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2496784 T5114 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2496784 T5114 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462
[junit4] 2> 2496785 T5114 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/'
[junit4] 2> 2496852 T5114 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/solr.xml
[junit4] 2> 2497003 T5114 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 2497004 T5114 oasc.CoreContainer.<init> New CoreContainer 2020173495
[junit4] 2> 2497005 T5114 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/]
[junit4] 2> 2497007 T5114 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 2497008 T5114 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2497008 T5114 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2497009 T5114 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2497010 T5114 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2497010 T5114 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2497011 T5114 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2497011 T5114 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2497012 T5114 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2497012 T5114 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 2497039 T5114 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2497040 T5114 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53560/solr
[junit4] 2> 2497040 T5114 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2497043 T5114 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2497046 T5152 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a27db73 name:ZooKeeperConnection Watcher:127.0.0.1:53560 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2497047 T5114 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2497051 T5114 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 2497068 T5114 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2497072 T5154 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ee357e7 name:ZooKeeperConnection Watcher:127.0.0.1:53560/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2497073 T5114 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2497083 T5114 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2498098 T5114 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53567_dx_sd
[junit4] 2> 2498101 T5114 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53567_dx_sd
[junit4] 2> 2498111 T5136 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2498112 T5154 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2498113 T5141 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2498125 T5114 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462
[junit4] 2> 2498290 T5114 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/conf/
[junit4] 2> 2498302 T5114 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 2498303 T5114 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2498304 T5114 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2498304 T5114 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2498808 T5114 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2498817 T5114 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53570
[junit4] 2> 2498818 T5114 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2498819 T5114 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2498819 T5114 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480
[junit4] 2> 2498820 T5114 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/'
[junit4] 2> 2498880 T5114 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/solr.xml
[junit4] 2> 2499017 T5114 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 2499018 T5114 oasc.CoreContainer.<init> New CoreContainer 776129677
[junit4] 2> 2499019 T5114 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/]
[junit4] 2> 2499021 T5114 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 2499022 T5114 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2499022 T5114 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2499023 T5114 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2499023 T5114 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2499024 T5114 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2499025 T5114 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2499025 T5114 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2499026 T5114 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2499026 T5114 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 2499048 T5114 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2499049 T5114 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53560/solr
[junit4] 2> 2499049 T5114 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2499052 T5114 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2499058 T5166 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53cd9ae7 name:ZooKeeperConnection Watcher:127.0.0.1:53560 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2499059 T5114 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2499063 T5114 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 2499090 T5114 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2499096 T5168 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@44fded40 name:ZooKeeperConnection Watcher:127.0.0.1:53560/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2499096 T5114 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2499108 T5114 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2500117 T5114 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53570_dx_sd
[junit4] 2> 2500128 T5114 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53570_dx_sd
[junit4] 2> 2500145 T5141 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2500147 T5168 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2500147 T5136 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2500167 T5114 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480
[junit4] 2> 2500182 T5154 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2500401 T5114 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/conf/
[junit4] 2> 2500416 T5114 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 2500419 T5114 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2500420 T5114 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2500420 T5114 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2501048 T5114 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2501057 T5114 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53573
[junit4] 2> 2501061 T5114 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2501062 T5114 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2501063 T5114 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597
[junit4] 2> 2501065 T5114 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/'
[junit4] 2> 2501154 T5114 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/solr.xml
[junit4] 2> 2501337 T5114 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 2501338 T5114 oasc.CoreContainer.<init> New CoreContainer 2064357773
[junit4] 2> 2501339 T5114 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/]
[junit4] 2> 2501346 T5114 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 2501347 T5114 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2501347 T5114 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2501348 T5114 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2501349 T5114 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2501349 T5114 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2501350 T5114 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2501351 T5114 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2501351 T5114 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2501352 T5114 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 2501374 T5114 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2501375 T5114 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53560/solr
[junit4] 2> 2501376 T5114 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2501378 T5114 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2501383 T5180 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18c4286d name:ZooKeeperConnection Watcher:127.0.0.1:53560 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2501385 T5114 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2501392 T5114 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 2501410 T5114 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2501421 T5182 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c4b3932 name:ZooKeeperConnection Watcher:127.0.0.1:53560/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2501422 T5114 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2501438 T5114 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2502450 T5114 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53573_dx_sd
[junit4] 2> 2502454 T5114 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53573_dx_sd
[junit4] 2> 2502478 T5168 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2502479 T5136 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2502480 T5141 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2502481 T5154 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2502480 T5182 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2502499 T5114 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597
[junit4] 2> 2502746 T5114 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/conf/
[junit4] 2> 2502755 T5114 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 2502756 T5114 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2502757 T5114 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2502758 T5114 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2503297 T5114 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2503312 T5114 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53576
[junit4] 2> 2503315 T5114 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2503315 T5114 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2503316 T5114 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939
[junit4] 2> 2503317 T5114 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/'
[junit4] 2> 2503392 T5114 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/solr.xml
[junit4] 2> 2503523 T5114 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 2503524 T5114 oasc.CoreContainer.<init> New CoreContainer 1744918452
[junit4] 2> 2503525 T5114 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/]
[junit4] 2> 2503527 T5114 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 2503527 T5114 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2503528 T5114 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2503529 T5114 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2503529 T5114 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2503530 T5114 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2503531 T5114 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2503531 T5114 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2503532 T5114 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2503532 T5114 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 2503553 T5114 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2503554 T5114 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53560/solr
[junit4] 2> 2503555 T5114 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2503562 T5114 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2503566 T5194 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@105287b9 name:ZooKeeperConnection Watcher:127.0.0.1:53560 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2503569 T5114 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2503574 T5114 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 2503593 T5114 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2503598 T5196 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3b4cd20d name:ZooKeeperConnection Watcher:127.0.0.1:53560/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2503598 T5114 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2503607 T5114 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2504616 T5114 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53576_dx_sd
[junit4] 2> 2504619 T5114 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53576_dx_sd
[junit4] 2> 2504627 T5136 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 2504629 T5196 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 2504640 T5141 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 2504640 T5182 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 2504641 T5168 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 2504641 T5154 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 2504650 T5114 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939
[junit4] 2> 2504818 T5114 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/conf/
[junit4] 2> 2504831 T5114 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 2504833 T5114 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2504834 T5114 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2504834 T5114 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2504857 T5114 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2504877 T5146 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4] 2> 2504880 T5136 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2504884 T5138 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":null,
[junit4] 2> "createNodeSet":null,
[junit4] 2> "name":"nodes_used_collection",
[junit4] 2> "replicationFactor":"2"}
[junit4] 2> 2504885 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica1 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:53570_dx_sd
[junit4] 2> 2504886 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica2 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:53567_dx_sd
[junit4] 2> 2504886 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica1 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:53576_dx_sd
[junit4] 2> 2504892 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica2 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:53573_dx_sd
[junit4] 2> 2504897 T5161 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=down
[junit4] 2> 2504901 T5176 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=down
[junit4] 2> 2504901 T5190 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=down
[junit4] 2> 2504905 T5147 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=down
[junit4] 2> 2504908 T5176 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2504909 T5161 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2504916 T5190 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2504916 T5147 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2505082 T5137 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2505085 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for nodes_used_collection, skipping publish state
[junit4] 2> 2505086 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2505086 T5137 oasc.Overseer$ClusterStateUpdater.createCollection Create collection nodes_used_collection with numShards 2
[junit4] 2> 2505100 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for nodes_used_collection, skipping publish state
[junit4] 2> 2505101 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2505114 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for nodes_used_collection, skipping publish state
[junit4] 2> 2505114 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2505126 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for nodes_used_collection, skipping publish state
[junit4] 2> 2505127 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2505139 T5168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2505140 T5141 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2505140 T5154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2505140 T5182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2505141 T5136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2505141 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2505910 T5176 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for nodes_used_collection_shard2_replica2
[junit4] 2> 2505920 T5161 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for nodes_used_collection_shard1_replica1
[junit4] 2> 2505923 T5190 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for nodes_used_collection_shard2_replica1
[junit4] 2> 2505924 T5161 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/nodes_used_collection_shard1_replica1/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/nodes_used_collection_shard1_replica1/core.properties (No such file or directory)
[junit4] 2> 2505928 T5161 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/nodes_used_collection_shard1_replica1
[junit4] 2> 2505929 T5161 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4] 2> 2505922 T5147 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for nodes_used_collection_shard1_replica2
[junit4] 2> 2505925 T5176 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/nodes_used_collection_shard2_replica2/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/nodes_used_collection_shard2_replica2/core.properties (No such file or directory)
[junit4] 2> 2505933 T5176 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/nodes_used_collection_shard2_replica2
[junit4] 2> 2505933 T5176 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4] 2> 2505925 T5190 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/nodes_used_collection_shard2_replica1/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/nodes_used_collection_shard2_replica1/core.properties (No such file or directory)
[junit4] 2> 2505935 T5190 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/nodes_used_collection_shard2_replica1
[junit4] 2> 2505936 T5190 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4] 2> 2505932 T5161 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4] 2> 2505938 T5161 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 2505932 T5147 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/nodes_used_collection_shard1_replica2/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/nodes_used_collection_shard1_replica2/core.properties (No such file or directory)
[junit4] 2> 2505940 T5147 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/nodes_used_collection_shard1_replica2
[junit4] 2> 2505941 T5147 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4] 2> 2505938 T5190 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4] 2> 2505936 T5176 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4] 2> 2505944 T5176 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 2505943 T5190 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 2505945 T5161 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 2505946 T5161 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4] 2> 2505945 T5147 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4] 2> 2505948 T5147 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 2505951 T5190 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 2505952 T5190 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4] 2> 2505953 T5176 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 2505954 T5176 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4] 2> 2505958 T5147 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 2505959 T5147 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4] 2> 2505970 T5176 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4] 2> 2505974 T5147 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4] 2> 2505979 T5176 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/nodes_used_collection_shard2_replica2/'
[junit4] 2> 2505981 T5161 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4] 2> 2505991 T5147 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/nodes_used_collection_shard1_replica2/'
[junit4] 2> 2505993 T5190 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4] 2> 2505996 T5161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/nodes_used_collection_shard1_replica1/'
[junit4] 2> 2506000 T5190 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/nodes_used_collection_shard2_replica1/'
[junit4] 2> 2506215 T5161 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2506286 T5147 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2506335 T5190 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2506536 T5176 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2506684 T5161 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2506710 T5161 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2506728 T5190 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2506764 T5147 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2506766 T5190 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2506795 T5147 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2506796 T5161 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica1] Schema name=test
[junit4] 2> 2506834 T5147 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica2] Schema name=test
[junit4] 2> 2506916 T5190 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica1] Schema name=test
[junit4] 2> 2506979 T5176 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2507002 T5176 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2507058 T5176 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica2] Schema name=test
[junit4] 2> 2510598 T5190 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2510600 T5190 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2510602 T5190 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2510632 T5190 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2510680 T5190 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2510800 T5147 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2510801 T5147 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2510803 T5147 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2510825 T5161 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2510826 T5161 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2510829 T5161 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2510855 T5161 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2510873 T5147 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2510873 T5190 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2510880 T5161 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2510894 T5147 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2510908 T5190 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2510928 T5190 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2510937 T5190 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2510937 T5190 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2510938 T5190 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2510942 T5190 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2510943 T5190 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2510944 T5190 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2510944 T5190 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/nodes_used_collection_shard2_replica1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//nodes_used_collection_shard2_replica1/data/
[junit4] 2> 2510945 T5190 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2510952 T5190 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//nodes_used_collection_shard2_replica1/data
[junit4] 2> 2510953 T5190 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//nodes_used_collection_shard2_replica1/data/index/
[junit4] 2> 2510954 T5190 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/nodes_used_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2510955 T5190 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//nodes_used_collection_shard2_replica1/data/index
[junit4] 2> 2510979 T5176 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2510980 T5176 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2510984 T5176 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2510984 T5190 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@38830f88 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3a72ed9e),segFN=segments_1,generation=1}
[junit4] 2> 2510985 T5190 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2510994 T5190 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2510995 T5190 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2510997 T5190 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2510998 T5190 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2510999 T5190 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2510999 T5190 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2511000 T5190 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2511000 T5190 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2511001 T5190 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2511029 T5176 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2511034 T5147 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2511035 T5190 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2511040 T5176 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2511043 T5161 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2511045 T5190 oass.SolrIndexSearcher.<init> Opening Searcher@4ba5e35d main
[junit4] 2> 2511047 T5190 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2511048 T5190 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2511054 T5202 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica1] Registered new searcher Searcher@4ba5e35d main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2511061 T5190 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica1
[junit4] 2> 2511062 T5190 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica1 address:http://127.0.0.1:53576/dx_sd collection:nodes_used_collection shard:shard2
[junit4] 2> 2511063 T5190 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2511071 T5147 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2511091 T5161 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2511107 T5190 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard2/election
[junit4] 2> 2511122 T5147 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2511129 T5147 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2511131 T5147 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2511132 T5147 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2511141 T5161 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2511142 T5147 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2511146 T5147 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2511147 T5161 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2511149 T5161 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2511152 T5161 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2511149 T5147 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2511155 T5147 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica2] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/nodes_used_collection_shard1_replica2/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//nodes_used_collection_shard1_replica2/data/
[junit4] 2> 2511156 T5147 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2511159 T5147 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//nodes_used_collection_shard1_replica2/data
[junit4] 2> 2511160 T5147 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//nodes_used_collection_shard1_replica2/data/index/
[junit4] 2> 2511161 T5147 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica2] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/nodes_used_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 2511162 T5147 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//nodes_used_collection_shard1_replica2/data/index
[junit4] 2> 2511166 T5161 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2511166 T5161 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2511170 T5161 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2511170 T5161 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/nodes_used_collection_shard1_replica1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//nodes_used_collection_shard1_replica1/data/
[junit4] 2> 2511171 T5161 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2511176 T5147 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5b9489c0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ae89518),segFN=segments_1,generation=1}
[junit4] 2> 2511178 T5147 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2511182 T5190 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 2511180 T5161 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//nodes_used_collection_shard1_replica1/data
[junit4] 2> 2511184 T5161 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//nodes_used_collection_shard1_replica1/data/index/
[junit4] 2> 2511184 T5161 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/nodes_used_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2511185 T5161 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//nodes_used_collection_shard1_replica1/data/index
[junit4] 2> 2511196 T5147 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2511197 T5147 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2511199 T5176 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2511200 T5147 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2511201 T5147 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2511210 T5147 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2511211 T5147 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2511211 T5147 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2511213 T5147 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2511215 T5147 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2511211 T5161 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5dc46e44 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f0d07cc),segFN=segments_1,generation=1}
[junit4] 2> 2511218 T5161 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2511233 T5190 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=179986
[junit4] 2> 2511236 T5161 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2511239 T5161 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2511241 T5161 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2511244 T5161 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2511256 T5161 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2511257 T5161 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2511258 T5161 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2511259 T5137 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2511271 T5161 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2511272 T5161 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2511277 T5147 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2511280 T5176 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2511277 T5161 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2511292 T5161 oass.SolrIndexSearcher.<init> Opening Searcher@3cb0d4aa main
[junit4] 2> 2511294 T5161 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2511295 T5161 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2511301 T5203 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica1] Registered new searcher Searcher@3cb0d4aa main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2511308 T5161 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica1
[junit4] 2> 2511308 T5161 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica1 address:http://127.0.0.1:53570/dx_sd collection:nodes_used_collection shard:shard1
[junit4] 2> 2511309 T5161 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2511316 T5176 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2511318 T5147 oass.SolrIndexSearcher.<init> Opening Searcher@77d8d25a main
[junit4] 2> 2511329 T5147 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2511332 T5147 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2511334 T5168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2511334 T5154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2511337 T5136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2511333 T5141 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2511337 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2511340 T5182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2511344 T5176 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2511436 T5176 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2511437 T5176 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2511441 T5204 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica2] Registered new searcher Searcher@77d8d25a main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2511444 T5147 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica2
[junit4] 2> 2511445 T5147 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica2 address:http://127.0.0.1:53567/dx_sd collection:nodes_used_collection shard:shard1
[junit4] 2> 2511445 T5147 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2511451 T5176 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2511453 T5176 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2511454 T5176 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2511455 T5176 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica2] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/nodes_used_collection_shard2_replica2/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//nodes_used_collection_shard2_replica2/data/
[junit4] 2> 2511456 T5176 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2511460 T5176 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//nodes_used_collection_shard2_replica2/data
[junit4] 2> 2511461 T5176 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//nodes_used_collection_shard2_replica2/data/index/
[junit4] 2> 2511462 T5176 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica2] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/nodes_used_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 2511464 T5176 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//nodes_used_collection_shard2_replica2/data/index
[junit4] 2> 2511487 T5176 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@11e15014 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5598f548),segFN=segments_1,generation=1}
[junit4] 2> 2511489 T5176 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2511488 T5161 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard1/election
[junit4] 2> 2511492 T5147 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard1/election
[junit4] 2> 2511521 T5176 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2511522 T5176 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2511526 T5176 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2511528 T5176 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2511529 T5176 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2511531 T5176 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2511539 T5176 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2511540 T5176 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2511541 T5176 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2511559 T5176 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2511571 T5147 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 2511575 T5176 oass.SolrIndexSearcher.<init> Opening Searcher@e645281 main
[junit4] 2> 2511577 T5176 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2511578 T5176 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2511593 T5205 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica2] Registered new searcher Searcher@e645281 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2511595 T5147 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2511596 T5147 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 2511596 T5147 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53567/dx_sd/nodes_used_collection_shard1_replica2/
[junit4] 2> 2511597 T5147 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica2 url=http://127.0.0.1:53567/dx_sd START replicas=[http://127.0.0.1:53570/dx_sd/nodes_used_collection_shard1_replica1/] nUpdates=100
[junit4] 2> 2511597 T5176 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica2
[junit4] 2> 2511598 T5176 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica2 address:http://127.0.0.1:53573/dx_sd collection:nodes_used_collection shard:shard2
[junit4] 2> 2511599 T5176 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2511598 T5147 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica2 url=http://127.0.0.1:53567/dx_sd DONE. We have no versions. sync failed.
[junit4] 2> 2511601 T5147 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2511610 T5147 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2511612 T5147 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53567/dx_sd/nodes_used_collection_shard1_replica2/ shard1
[junit4] 2> 2511612 T5147 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard1
[junit4] 2> ASYNC NEW_CORE C1176 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore@3e70aed6 url=http://127.0.0.1:53570/dx_sd/nodes_used_collection_shard1_replica1 node=127.0.0.1:53570_dx_sd C1176_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{state=down, core=nodes_used_collection_shard1_replica1, node_name=127.0.0.1:53570_dx_sd, base_url=http://127.0.0.1:53570/dx_sd}
[junit4] 2> 2511615 T5162 C1176 P53570 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4] 2> 2511738 T5190 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2511738 T5190 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 2511739 T5190 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53576/dx_sd/nodes_used_collection_shard2_replica1/
[junit4] 2> 2511739 T5190 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica1 url=http://127.0.0.1:53576/dx_sd START replicas=[http://127.0.0.1:53573/dx_sd/nodes_used_collection_shard2_replica2/] nUpdates=100
[junit4] 2> 2511740 T5190 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica1 url=http://127.0.0.1:53576/dx_sd DONE. We have no versions. sync failed.
[junit4] 2> 2511740 T5190 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2511741 T5190 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2511743 T5190 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53576/dx_sd/nodes_used_collection_shard2_replica1/ shard2
[junit4] 2> 2511745 T5190 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard2
[junit4] 2> ASYNC NEW_CORE C1177 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@772dd276 url=http://127.0.0.1:53573/dx_sd/nodes_used_collection_shard2_replica2 node=127.0.0.1:53573_dx_sd C1177_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{state=down, core=nodes_used_collection_shard2_replica2, node_name=127.0.0.1:53573_dx_sd, base_url=http://127.0.0.1:53573/dx_sd}
[junit4] 2> 2511755 T5173 C1177 P53573 oasc.SolrCore.execute [nodes_used_collection_shard2_replica2] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2512957 T5137 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2512995 T5154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2512996 T5136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2512999 T5168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2512999 T5182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2513000 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2513001 T5141 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2513054 T5147 oasc.ZkController.register We are http://127.0.0.1:53567/dx_sd/nodes_used_collection_shard1_replica2/ and leader is http://127.0.0.1:53567/dx_sd/nodes_used_collection_shard1_replica2/
[junit4] 2> 2513055 T5147 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica2 baseURL=http://127.0.0.1:53567/dx_sd
[junit4] 2> 2513055 T5147 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2513056 T5147 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=active
[junit4] 2> 2513059 T5147 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2513059 T5176 oasc.ZkController.register We are http://127.0.0.1:53573/dx_sd/nodes_used_collection_shard2_replica2/ and leader is http://127.0.0.1:53576/dx_sd/nodes_used_collection_shard2_replica1/
[junit4] 2> 2513060 T5176 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica2 baseURL=http://127.0.0.1:53573/dx_sd
[junit4] 2> 2513062 T5176 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard2_replica2
[junit4] 2> 2513063 T5176 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2513064 T5161 oasc.ZkController.register We are http://127.0.0.1:53570/dx_sd/nodes_used_collection_shard1_replica1/ and leader is http://127.0.0.1:53567/dx_sd/nodes_used_collection_shard1_replica2/
[junit4] 2> 2513065 T5161 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica1 baseURL=http://127.0.0.1:53570/dx_sd
[junit4] 2> 2513065 T5161 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard1_replica1
[junit4] 2> 2513066 T5161 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2513067 T5190 oasc.ZkController.register We are http://127.0.0.1:53576/dx_sd/nodes_used_collection_shard2_replica1/ and leader is http://127.0.0.1:53576/dx_sd/nodes_used_collection_shard2_replica1/
[junit4] 2> 2513067 T5190 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica1 baseURL=http://127.0.0.1:53576/dx_sd
[junit4] 2> 2513068 T5190 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2513069 T5190 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=active
[junit4] 2> 2513074 T5208 C1177 P53573 oasc.RecoveryStrategy.run Starting recovery process. core=nodes_used_collection_shard2_replica2 recoveringAfterStartup=true
[junit4] 2> 2513075 T5208 C1177 P53573 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2513075 T5209 C1176 P53570 oasc.RecoveryStrategy.run Starting recovery process. core=nodes_used_collection_shard1_replica1 recoveringAfterStartup=true
[junit4] 2> 2513077 T5209 C1176 P53570 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2513077 T5147 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=8175
[junit4] 2> 2513077 T5208 C1177 P53573 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=recovering
[junit4] 2> 2513078 T5209 C1176 P53570 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=recovering
[junit4] 2> 2513082 T5176 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2513082 T5161 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2513086 T5208 C1177 P53573 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2513087 T5190 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2513089 T5209 C1176 P53570 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2513105 T5176 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=8205
[junit4] 2> 2513107 T5161 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=8213
[junit4] 2> 2513120 T5190 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=8220
[junit4] 2> 2513122 T5138 oasc.OverseerCollectionProcessor.createCollection Finished create command on all shards for collection: nodes_used_collection
[junit4] 2> 2513140 T5191 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2513147 T5145 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2513147 T5154 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work/qnr-0000000000 state: SyncConnected type NodeDataChanged
[junit4] 2> 2513155 T5136 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2513156 T5146 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2} status=0 QTime=8279
[junit4] 2> 2513158 T5114 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4] 2> 2513161 T5114 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2513162 T5138 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000000 complete, response:{success={null={responseHeader={status=0,QTime=8175},core=nodes_used_collection_shard1_replica2},null={responseHeader={status=0,QTime=8205},core=nodes_used_collection_shard2_replica2},null={responseHeader={status=0,QTime=8213},core=nodes_used_collection_shard1_replica1},null={responseHeader={status=0,QTime=8220},core=nodes_used_collection_shard2_replica1}}}
[junit4] 2> 2513168 T5211 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14f659b6 name:ZooKeeperConnection Watcher:127.0.0.1:53560/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2513169 T5114 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2513173 T5114 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2513183 T5114 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4] 2> 2513187 T5114 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2513206 T5213 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@71bb6b57 name:ZooKeeperConnection Watcher:127.0.0.1:53560/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2513207 T5114 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2513213 T5114 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2513244 T5178 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=5&maxShardsPerNode=6&name=awholynewcollection_0&replicationFactor=5&action=CREATE&wt=javabin&version=2
[junit4] 2> 2513249 T5136 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2513255 T5138 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000002 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "numShards":"5",
[junit4] 2> "maxShardsPerNode":"6",
[junit4] 2> "createNodeSet":null,
[junit4] 2> "name":"awholynewcollection_0",
[junit4] 2> "replicationFactor":"5"}
[junit4] 2> 2513256 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica1 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:53567_dx_sd
[junit4] 2> 2513256 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica2 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:53570_dx_sd
[junit4] 2> 2513257 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica3 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:53576_dx_sd
[junit4] 2> 2513258 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica4 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:53573_dx_sd
[junit4] 2> 2513259 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica5 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:53563_dx_sd
[junit4] 2> 2513261 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica1 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:53567_dx_sd
[junit4] 2> 2513266 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica2 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:53570_dx_sd
[junit4] 2> 2513279 T5192 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica3 state=down
[junit4] 2> 2513275 T5160 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica2 state=down
[junit4] 2> 2513274 T5148 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica1 state=down
[junit4] 2> 2513284 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica3 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:53576_dx_sd
[junit4] 2> 2513274 T5173 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica4 state=down
[junit4] 2> 2513284 T5149 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica1 state=down
[junit4] 2> 2513281 T5127 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica5 state=down
[junit4] 2> 2513297 T5148 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513287 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica4 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:53573_dx_sd
[junit4] 2> 2513298 T5163 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica2 state=down
[junit4] 2> 2513301 T5187 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica3 state=down
[junit4] 2> 2513299 T5192 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513304 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica5 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:53563_dx_sd
[junit4] 2> 2513307 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica1 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:53567_dx_sd
[junit4] 2> 2513310 T5160 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513311 T5173 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513312 T5174 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica4 state=down
[junit4] 2> 2513315 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica2 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:53570_dx_sd
[junit4] 2> 2513319 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica3 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:53576_dx_sd
[junit4] 2> 2513329 T5163 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513342 T5164 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica2 state=down
[junit4] 2> 2513325 T5187 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513322 T5149 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513347 T5127 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513348 T5164 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513341 T5189 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica3 state=down
[junit4] 2> 2513335 T5147 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica1 state=down
[junit4] 2> 2513334 T5128 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica5 state=down
[junit4] 2> 2513332 T5174 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513331 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica4 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:53573_dx_sd
[junit4] 2> 2513356 T5189 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513357 T5147 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513360 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica5 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:53563_dx_sd
[junit4] 2> 2513366 T5177 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica4 state=down
[junit4] 2> 2513362 T5128 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513381 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica1 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:53567_dx_sd
[junit4] 2> 2513383 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica2 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:53570_dx_sd
[junit4] 2> 2513388 T5130 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica5 state=down
[junit4] 2> 2513391 T5146 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica1 state=down
[junit4] 2> 2513394 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica3 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:53576_dx_sd
[junit4] 2> 2513402 T5159 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica2 state=down
[junit4] 2> 2513404 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica4 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:53573_dx_sd
[junit4] 2> 2513409 T5190 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica3 state=down
[junit4] 2> 2513411 T5146 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513404 T5177 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513417 T5176 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica4 state=down
[junit4] 2> 2513412 T5130 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513412 T5159 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513409 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica5 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:53563_dx_sd
[junit4] 2> 2513423 T5190 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513426 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard5_replica1 as part of slice shard5 of collection awholynewcollection_0 on 127.0.0.1:53567_dx_sd
[junit4] 2> 2513428 T5176 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513431 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard5_replica2 as part of slice shard5 of collection awholynewcollection_0 on 127.0.0.1:53570_dx_sd
[junit4] 2> 2513437 T5131 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica5 state=down
[junit4] 2> 2513440 T5150 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica1 state=down
[junit4] 2> 2513443 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard5_replica3 as part of slice shard5 of collection awholynewcollection_0 on 127.0.0.1:53576_dx_sd
[junit4] 2> 2513445 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard5_replica4 as part of slice shard5 of collection awholynewcollection_0 on 127.0.0.1:53573_dx_sd
[junit4] 2> 2513453 T5188 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica3 state=down
[junit4] 2> 2513452 T5131 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513452 T5150 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513451 T5161 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica2 state=down
[junit4] 2> 2513462 T5188 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513462 T5175 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica4 state=down
[junit4] 2> 2513458 T5138 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard5_replica5 as part of slice shard5 of collection awholynewcollection_0 on 127.0.0.1:53563_dx_sd
[junit4] 2> 2513475 T5161 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513476 T5175 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2513477 T5132 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica5 state=down
[junit4] 2> 2513484 T5132 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2514557 T5137 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2514559 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2514569 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2514580 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2514590 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2514610 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514611 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2514611 T5137 oasc.Overseer$ClusterStateUpdater.createCollection Create collection awholynewcollection_0 with numShards 5
[junit4] 2> 2514625 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514626 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2514639 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514640 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2514652 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514653 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2514667 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514668 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node5",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2514693 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514693 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node6",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2514705 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514706 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node7",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2514718 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514719 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node8",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2514731 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514732 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node9",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53563_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53563/dx_sd"}
[junit4] 2> 2514745 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514746 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node10",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2514764 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514765 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node11",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2514784 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514786 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node12",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2514800 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514801 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node13",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53563_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53563/dx_sd"}
[junit4] 2> 2514811 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514812 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node14",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2514824 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514826 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node15",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53563_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53563/dx_sd"}
[junit4] 2> 2514837 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514838 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node16",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2514849 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514850 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node17",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2514867 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514868 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node18",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2514883 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514884 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node19",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2514901 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514902 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node20",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53563_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53563/dx_sd"}
[junit4] 2> 2514915 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514916 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node21",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2514931 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514932 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node22",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2514948 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514949 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node23",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2514964 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514965 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node24",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2514976 T5137 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 2514981 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node25",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53563_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53563/dx_sd"}
[junit4] 2> 2515004 T5136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2515005 T5168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2515005 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2515005 T5154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2515005 T5213 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2515005 T5182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2515005 T5211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2515005 T5141 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2515145 T5191 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 2515146 T5191 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node2&state=recovering&nodeName=127.0.0.1:53573_dx_sd&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard2_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2006
[junit4] 2> 2515154 T5145 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 2515156 T5145 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node1&state=recovering&nodeName=127.0.0.1:53570_dx_sd&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard1_replica2&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2009
[junit4] 2> 2515300 T5148 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard1_replica1
[junit4] 2> 2515303 T5148 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard1_replica1/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard1_replica1/core.properties (No such file or directory)
[junit4] 2> 2515305 T5148 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard1_replica1
[junit4] 2> 2515306 T5148 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515306 T5192 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard1_replica3
[junit4] 2> 2515310 T5192 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard1_replica3/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard1_replica3/core.properties (No such file or directory)
[junit4] 2> 2515311 T5192 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica3' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard1_replica3
[junit4] 2> 2515312 T5192 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515314 T5160 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard1_replica2
[junit4] 2> 2515316 T5160 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard1_replica2/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard1_replica2/core.properties (No such file or directory)
[junit4] 2> 2515317 T5160 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard1_replica2
[junit4] 2> 2515317 T5160 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515319 T5173 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard1_replica4
[junit4] 2> 2515321 T5173 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard1_replica4/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard1_replica4/core.properties (No such file or directory)
[junit4] 2> 2515322 T5173 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica4' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard1_replica4
[junit4] 2> 2515323 T5173 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515324 T5148 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4] 2> 2515325 T5160 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4] 2> 2515326 T5148 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 2515326 T5173 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4] 2> 2515328 T5173 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 2515326 T5160 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 2515326 T5192 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4] 2> 2515332 T5192 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 2515340 T5173 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 2515342 T5173 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4] 2> 2515340 T5192 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 2515345 T5192 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4] 2> 2515343 T5148 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 2515350 T5148 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4] 2> 2515343 T5160 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 2515351 T5164 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard3_replica2
[junit4] 2> 2515351 T5127 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard1_replica5
[junit4] 2> 2515355 T5164 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard3_replica2/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard3_replica2/core.properties (No such file or directory)
[junit4] 2> 2515356 T5164 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard3_replica2
[junit4] 2> 2515357 T5164 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515349 T5149 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard2_replica1
[junit4] 2> 2515349 T5187 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard2_replica3
[junit4] 2> 2515360 T5149 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard2_replica1/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard2_replica1/core.properties (No such file or directory)
[junit4] 2> 2515361 T5149 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard2_replica1
[junit4] 2> 2515362 T5149 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515347 T5163 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard2_replica2
[junit4] 2> 2515363 T5189 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard3_replica3
[junit4] 2> 2515366 T5163 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard2_replica2/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard2_replica2/core.properties (No such file or directory)
[junit4] 2> 2515367 T5163 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard2_replica2
[junit4] 2> 2515367 T5163 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515363 T5174 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard2_replica4
[junit4] 2> 2515362 T5147 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard3_replica1
[junit4] 2> 2515370 T5174 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard2_replica4/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard2_replica4/core.properties (No such file or directory)
[junit4] 2> 2515371 T5147 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard3_replica1/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard3_replica1/core.properties (No such file or directory)
[junit4] 2> 2515372 T5147 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard3_replica1
[junit4] 2> 2515373 T5147 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515361 T5187 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard2_replica3/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard2_replica3/core.properties (No such file or directory)
[junit4] 2> 2515375 T5187 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica3' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard2_replica3
[junit4] 2> 2515376 T5187 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515356 T5127 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard1_replica5/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard1_replica5/core.properties (No such file or directory)
[junit4] 2> 2515379 T5127 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica5' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard1_replica5
[junit4] 2> 2515381 T5127 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515383 T5128 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard2_replica5
[junit4] 2> 2515384 T5149 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2515385 T5149 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515353 T5160 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4] 2> 2515387 T5147 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2515388 T5147 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515385 T5128 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard2_replica5/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard2_replica5/core.properties (No such file or directory)
[junit4] 2> 2515390 T5128 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica5' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard2_replica5
[junit4] 2> 2515392 T5128 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515394 T5187 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2515395 T5187 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515384 T5163 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2515397 T5163 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515383 T5164 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2515400 T5164 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515371 T5174 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica4' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard2_replica4
[junit4] 2> 2515403 T5174 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515366 T5189 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard3_replica3/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard3_replica3/core.properties (No such file or directory)
[junit4] 2> 2515405 T5189 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica3' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard3_replica3
[junit4] 2> 2515406 T5189 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515395 T5173 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515410 T5127 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2515411 T5127 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515405 T5192 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515416 T5149 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard2_replica1/'
[junit4] 2> 2515422 T5146 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard4_replica1
[junit4] 2> 2515424 T5177 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard3_replica4
[junit4] 2> 2515429 T5159 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard4_replica2
[junit4] 2> 2515430 T5177 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard3_replica4/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard3_replica4/core.properties (No such file or directory)
[junit4] 2> 2515431 T5177 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica4' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard3_replica4
[junit4] 2> 2515432 T5177 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515432 T5176 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard4_replica4
[junit4] 2> 2515428 T5130 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard3_replica5
[junit4] 2> 2515436 T5176 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard4_replica4/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard4_replica4/core.properties (No such file or directory)
[junit4] 2> 2515437 T5176 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica4' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard4_replica4
[junit4] 2> 2515438 T5176 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515428 T5146 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard4_replica1/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard4_replica1/core.properties (No such file or directory)
[junit4] 2> 2515444 T5146 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard4_replica1
[junit4] 2> 2515445 T5146 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515444 T5189 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2515447 T5189 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515437 T5130 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard3_replica5/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard3_replica5/core.properties (No such file or directory)
[junit4] 2> 2515449 T5130 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica5' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard3_replica5
[junit4] 2> 2515451 T5130 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515435 T5128 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2515454 T5128 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515431 T5190 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard4_replica3
[junit4] 2> 2515431 T5159 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard4_replica2/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard4_replica2/core.properties (No such file or directory)
[junit4] 2> 2515457 T5159 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard4_replica2
[junit4] 2> 2515458 T5159 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515446 T5174 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2515459 T5174 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515460 T5187 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard2_replica3/'
[junit4] 2> 2515462 T5131 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard4_replica5
[junit4] 2> 2515465 T5131 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard4_replica5/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard4_replica5/core.properties (No such file or directory)
[junit4] 2> 2515466 T5131 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica5' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard4_replica5
[junit4] 2> 2515467 T5131 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515445 T5147 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard3_replica1/'
[junit4] 2> 2515445 T5148 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515467 T5188 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard5_replica3
[junit4] 2> 2515467 T5150 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard5_replica1
[junit4] 2> 2515483 T5161 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard5_replica2
[junit4] 2> 2515484 T5175 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard5_replica4
[junit4] 2> 2515460 T5146 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2515460 T5176 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2515487 T5176 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515459 T5177 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2515488 T5177 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515457 T5190 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard4_replica3/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard4_replica3/core.properties (No such file or directory)
[junit4] 2> 2515499 T5190 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica3' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard4_replica3
[junit4] 2> 2515500 T5190 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515487 T5175 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard5_replica4/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard5_replica4/core.properties (No such file or directory)
[junit4] 2> 2515485 T5161 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard5_replica2/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard5_replica2/core.properties (No such file or directory)
[junit4] 2> 2515504 T5161 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard5_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard5_replica2
[junit4] 2> 2515505 T5161 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515484 T5150 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard5_replica1/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard5_replica1/core.properties (No such file or directory)
[junit4] 2> 2515507 T5150 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard5_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard5_replica1
[junit4] 2> 2515508 T5150 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515482 T5188 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard5_replica3/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard5_replica3/core.properties (No such file or directory)
[junit4] 2> 2515511 T5188 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard5_replica3' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard5_replica3
[junit4] 2> 2515511 T5188 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515510 T5192 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard1_replica3/'
[junit4] 2> 2515515 T5159 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2515517 T5159 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515508 T5130 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2515519 T5130 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515504 T5164 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard3_replica2/'
[junit4] 2> 2515522 T5190 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2515523 T5190 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515503 T5163 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard2_replica2/'
[junit4] 2> 2515526 T5148 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard1_replica1/'
[junit4] 2> 2515503 T5160 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515503 T5175 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard5_replica4' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard5_replica4
[junit4] 2> 2515541 T5175 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515502 T5132 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard5_replica5
[junit4] 2> 2515502 T5146 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515545 T5132 oasc.CorePropertiesLocator.writePropertiesFile ERROR Couldn't persist core properties to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard5_replica5/core.properties: java.io.FileNotFoundException: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard5_replica5/core.properties (No such file or directory)
[junit4] 2> 2515547 T5132 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard5_replica5' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard5_replica5
[junit4] 2> 2515548 T5132 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 2515545 T5128 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard2_replica5/'
[junit4] 2> 2515524 T5161 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2515551 T5161 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515523 T5150 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2515553 T5150 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515522 T5188 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2515554 T5188 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515521 T5174 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard2_replica4/'
[junit4] 2> 2515518 T5131 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2515557 T5131 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515515 T5127 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard1_replica5/'
[junit4] 2> 2515562 T5177 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard3_replica4/'
[junit4] 2> 2515512 T5189 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard3_replica3/'
[junit4] 2> 2515566 T5190 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard4_replica3/'
[junit4] 2> 2515511 T5173 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard1_replica4/'
[junit4] 2> 2515563 T5175 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2515571 T5175 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515549 T5176 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard4_replica4/'
[junit4] 2> 2515578 T5159 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard4_replica2/'
[junit4] 2> 2515610 T5160 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard1_replica2/'
[junit4] 2> 2515629 T5161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard5_replica2/'
[junit4] 2> 2515677 T5188 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard5_replica3/'
[junit4] 2> 2515680 T5146 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard4_replica1/'
[junit4] 2> 2515688 T5150 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard5_replica1/'
[junit4] 2> 2515692 T5175 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard5_replica4/'
[junit4] 2> 2515697 T5132 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2515700 T5132 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 2515701 T5130 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard3_replica5/'
[junit4] 2> 2515720 T5131 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard4_replica5/'
[junit4] 2> 2515754 T5132 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard5_replica5/'
[junit4] 2> 2516630 T5163 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2516643 T5148 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2516722 T5160 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2516745 T5149 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2516752 T5190 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2516800 T5189 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2516821 T5173 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2516829 T5159 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2516992 T5147 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2517099 T5192 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> ASYNC NEW_CORE C1178 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@772dd276 url=http://127.0.0.1:53573/dx_sd/nodes_used_collection_shard2_replica2 node=127.0.0.1:53573_dx_sd C1178_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{state=recovering, core=nodes_used_collection_shard2_replica2, node_name=127.0.0.1:53573_dx_sd, base_url=http://127.0.0.1:53573/dx_sd}
[junit4] 2> 2517155 T5208 C1178 P53573 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53576/dx_sd/nodes_used_collection_shard2_replica1/ core=nodes_used_collection_shard2_replica2 - recoveringAfterStartup=true
[junit4] 2> 2517156 T5208 C1178 P53573 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:53573/dx_sd START replicas=[http://127.0.0.1:53576/dx_sd/nodes_used_collection_shard2_replica1/] nUpdates=100
[junit4] 2> 2517159 T5208 C1178 P53573 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2517160 T5208 C1178 P53573 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=nodes_used_collection_shard2_replica2
[junit4] 2> 2517162 T5208 C1178 P53573 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=nodes_used_collection_shard2_replica2
[junit4] 2> 2517163 T5208 C1178 P53573 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=nodes_used_collection_shard2_replica2
[junit4] 2> 2517163 T5208 C1178 P53573 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2517164 T5208 C1178 P53573 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53576/dx_sd/nodes_used_collection_shard2_replica1/. core=nodes_used_collection_shard2_replica2
[junit4] 2> 2517164 T5208 C1178 P53573 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> ASYNC NEW_CORE C1179 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore@3e70aed6 url=http://127.0.0.1:53570/dx_sd/nodes_used_collection_shard1_replica1 node=127.0.0.1:53570_dx_sd C1179_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{state=recovering, core=nodes_used_collection_shard1_replica1, node_name=127.0.0.1:53570_dx_sd, base_url=http://127.0.0.1:53570/dx_sd}
[junit4] 2> 2517160 T5209 C1179 P53570 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53567/dx_sd/nodes_used_collection_shard1_replica2/ core=nodes_used_collection_shard1_replica1 - recoveringAfterStartup=true
[junit4] 2> 2517169 T5209 C1179 P53570 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica1 url=http://127.0.0.1:53570/dx_sd START replicas=[http://127.0.0.1:53567/dx_sd/nodes_used_collection_shard1_replica2/] nUpdates=100
[junit4] 2> 2517170 T5209 C1179 P53570 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2517171 T5209 C1179 P53570 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=nodes_used_collection_shard1_replica1
[junit4] 2> 2517171 T5209 C1179 P53570 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=nodes_used_collection_shard1_replica1
[junit4] 2> 2517172 T5209 C1179 P53570 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=nodes_used_collection_shard1_replica1
[junit4] 2> 2517172 T5209 C1179 P53570 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2517172 T5209 C1179 P53570 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53567/dx_sd/nodes_used_collection_shard1_replica2/. core=nodes_used_collection_shard1_replica1
[junit4] 2> 2517173 T5209 C1179 P53570 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> ASYNC NEW_CORE C1180 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@5d7f12f3 url=http://127.0.0.1:53567/dx_sd/nodes_used_collection_shard1_replica2 node=127.0.0.1:53567_dx_sd C1180_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{state=active, core=nodes_used_collection_shard1_replica2, node_name=127.0.0.1:53567_dx_sd, base_url=http://127.0.0.1:53567/dx_sd, leader=true}
[junit4] 2> 2517198 T5145 C1180 P53567 oasc.SolrCore.execute [nodes_used_collection_shard1_replica2] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=8
[junit4] 2> 2517337 T5187 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2517459 T5174 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2517462 T5164 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2517529 T5238 C1180 P53567 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> ASYNC NEW_CORE C1181 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@496b76e0 url=http://127.0.0.1:53576/dx_sd/nodes_used_collection_shard2_replica1 node=127.0.0.1:53576_dx_sd C1181_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{state=active, core=nodes_used_collection_shard2_replica1, node_name=127.0.0.1:53576_dx_sd, base_url=http://127.0.0.1:53576/dx_sd, leader=true}
[junit4] 2> 2517590 T5239 C1181 P53576 oasc.SolrCore.execute [nodes_used_collection_shard2_replica1] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=74
[junit4] 2> 2517619 T5191 C1181 P53576 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2517691 T5238 C1180 P53567 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5b9489c0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ae89518),segFN=segments_1,generation=1}
[junit4] 2> 2517700 T5238 C1180 P53567 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2517701 T5238 C1180 P53567 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2517702 T5238 C1180 P53567 oass.SolrIndexSearcher.<init> Opening Searcher@53df8eaa realtime
[junit4] 2> 2517703 T5238 C1180 P53567 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2517704 T5238 C1180 P53567 oasup.LogUpdateProcessor.finish [nodes_used_collection_shard1_replica2] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 175
[junit4] 2> 2517720 T5209 C1179 P53570 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2517720 T5209 C1179 P53570 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2517854 T5145 C1180 P53567 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2517855 T5145 C1180 P53567 oasc.SolrCore.execute [nodes_used_collection_shard1_replica2] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=8
[junit4] 2> 2517861 T5209 C1179 P53570 oasc.RecoveryStrategy.replay No replay needed. core=nodes_used_collection_shard1_replica1
[junit4] 2> 2517862 T5209 C1179 P53570 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=nodes_used_collection_shard1_replica1
[junit4] 2> 2517862 T5209 C1179 P53570 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=active
[junit4] 2> 2517875 T5209 C1179 P53570 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=nodes_used_collection_shard1_replica1
[junit4] 2> 2517992 T5130 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2518032 T5188 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2518305 T5137 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2518318 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2518319 T5131 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> ASYNC NEW_CORE C1182 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@496b76e0 url=http://127.0.0.1:53576/dx_sd/nodes_used_collection_shard2_replica1 node=127.0.0.1:53576_dx_sd C1182_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{state=active, core=nodes_used_collection_shard2_replica1, node_name=127.0.0.1:53576_dx_sd, base_url=http://127.0.0.1:53576/dx_sd, leader=true}
[junit4] 2> 2518345 T5191 C1182 P53576 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@38830f88 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3a72ed9e),segFN=segments_1,generation=1}
[junit4] 2> 2518369 T5154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2518370 T5168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2518371 T5211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2518372 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2518370 T5213 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2518372 T5182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2518371 T5141 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2518374 T5136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2518410 T5191 C1182 P53576 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2518411 T5191 C1182 P53576 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2518412 T5191 C1182 P53576 oass.SolrIndexSearcher.<init> Opening Searcher@68791bac realtime
[junit4] 2> 2518413 T5191 C1182 P53576 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2518414 T5191 C1182 P53576 oasup.LogUpdateProcessor.finish [nodes_used_collection_shard2_replica1] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 795
[junit4] 2> ASYNC NEW_CORE C1183 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@772dd276 url=http://127.0.0.1:53573/dx_sd/nodes_used_collection_shard2_replica2 node=127.0.0.1:53573_dx_sd C1183_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{state=recovering, core=nodes_used_collection_shard2_replica2, node_name=127.0.0.1:53573_dx_sd, base_url=http://127.0.0.1:53573/dx_sd}
[junit4] 2> 2518416 T5208 C1183 P53573 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2518417 T5208 C1183 P53573 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2518428 T5239 C1182 P53576 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2518430 T5239 C1182 P53576 oasc.SolrCore.execute [nodes_used_collection_shard2_replica1] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=7
[junit4] 2> 2518432 T5208 C1183 P53573 oasc.RecoveryStrategy.replay No replay needed. core=nodes_used_collection_shard2_replica2
[junit4] 2> 2518432 T5208 C1183 P53573 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=nodes_used_collection_shard2_replica2
[junit4] 2> 2518433 T5208 C1183 P53573 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=active
[junit4] 2> 2518447 T5208 C1183 P53573 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=nodes_used_collection_shard2_replica2
[junit4] 2> 2518532 T5192 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2518548 T5175 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2518551 T5192 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2518560 T5150 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2518573 T5148 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2518590 T5148 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2518641 T5127 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2518695 T5146 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2518699 T5128 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2518708 T5148 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica1] Schema name=test
[junit4] 2> 2518729 T5132 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2518735 T5192 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica3] Schema name=test
[junit4] 2> 2518823 T5190 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2518851 T5190 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2518864 T5161 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2518883 T5177 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2518915 T5173 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2518941 T5173 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2519003 T5190 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica3] Schema name=test
[junit4] 2> 2519010 T5147 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2519153 T5189 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2519154 T5147 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2519168 T5189 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2519205 T5189 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica3] Schema name=test
[junit4] 2> 2519263 T5176 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 2519295 T5173 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica4] Schema name=test
[junit4] 2> 2519349 T5160 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2519368 T5160 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2519380 T5147 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica1] Schema name=test
[junit4] 2> 2519454 T5163 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2519465 T5163 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2519621 T5163 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica2] Schema name=test
[junit4] 2> 2519655 T5160 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica2] Schema name=test
[junit4] 2> 2519669 T5149 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2519673 T5149 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2519684 T5187 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2519694 T5187 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2519817 T5159 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2519839 T5159 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2519845 T5164 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2519873 T5164 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2520064 T5137 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2520075 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2520100 T5149 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica1] Schema name=test
[junit4] 2> 2520109 T5187 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica3] Schema name=test
[junit4] 2> 2520120 T5159 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica2] Schema name=test
[junit4] 2> 2520181 T5154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2520183 T5168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2520184 T5213 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2520184 T5141 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2520184 T5211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2520185 T5182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2520185 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2520188 T5136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2520216 T5164 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica2] Schema name=test
[junit4] 2> 2520303 T5130 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2520329 T5130 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2520334 T5161 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2520346 T5130 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica5] Schema name=test
[junit4] 2> 2520365 T5131 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2520385 T5161 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2520388 T5131 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2520490 T5161 oass.IndexSchema.readSchema [awholynewcollection_0_shard5_replica2] Schema name=test
[junit4] 2> 2520533 T5177 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2520553 T5177 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2520566 T5177 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica4] Schema name=test
[junit4] 2> 2520671 T5127 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2520704 T5127 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2520762 T5188 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2520764 T5150 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2520793 T5150 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2520942 T5175 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2520946 T5175 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2520947 T5132 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2520950 T5188 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2520975 T5132 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2520995 T5127 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica5] Schema name=test
[junit4] 2> 2521017 T5146 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2521021 T5146 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2521042 T5146 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica1] Schema name=test
[junit4] 2> 2521064 T5132 oass.IndexSchema.readSchema [awholynewcollection_0_shard5_replica5] Schema name=test
[junit4] 2> 2521072 T5131 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica5] Schema name=test
[junit4] 2> 2521087 T5150 oass.IndexSchema.readSchema [awholynewcollection_0_shard5_replica1] Schema name=test
[junit4] 2> 2521243 T5174 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2521251 T5174 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2521252 T5175 oass.IndexSchema.readSchema [awholynewcollection_0_shard5_replica4] Schema name=test
[junit4] 2> 2521268 T5174 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica4] Schema name=test
[junit4] 2> 2521348 T5128 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2521384 T5188 oass.IndexSchema.readSchema [awholynewcollection_0_shard5_replica3] Schema name=test
[junit4] 2> 2521387 T5128 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2521402 T5128 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica5] Schema name=test
[junit4] 2> 2522497 T5176 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2522536 T5176 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2522922 T5176 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica4] Schema name=test
[junit4] 2> 2536927 T5192 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2536928 T5192 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2536930 T5192 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2537128 T5192 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2537238 T5192 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2537751 T5192 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2537809 T5192 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2538034 T5192 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2538051 T5192 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2538052 T5192 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2538052 T5192 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2538058 T5192 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2538059 T5192 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2538060 T5192 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2538061 T5192 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica3] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard1_replica3/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard1_replica3/data/
[junit4] 2> 2538062 T5192 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2538075 T5192 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard1_replica3/data
[junit4] 2> 2538076 T5192 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard1_replica3/data/index/
[junit4] 2> 2538077 T5192 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard1_replica3] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard1_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 2538077 T5192 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard1_replica3/data/index
[junit4] 2> 2538171 T5192 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@553d9432 lockFactory=org.apache.lucene.store.NativeFSLockFactory@10eab6ad),segFN=segments_1,generation=1}
[junit4] 2> 2538172 T5192 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2538187 T5192 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2538189 T5192 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2538191 T5192 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2538194 T5192 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2538315 T5192 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2538316 T5192 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2538317 T5192 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2538320 T5192 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2538322 T5192 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2538636 T5192 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2538675 T5192 oass.SolrIndexSearcher.<init> Opening Searcher@a65652e main
[junit4] 2> 2538679 T5192 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2538680 T5192 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2538713 T5163 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2538714 T5163 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2538717 T5163 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2538754 T5243 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard1_replica3] Registered new searcher Searcher@a65652e main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2538757 T5192 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard1_replica3
[junit4] 2> 2538758 T5192 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard1_replica3 address:http://127.0.0.1:53576/dx_sd collection:awholynewcollection_0 shard:shard1
[junit4] 2> 2538759 T5192 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2539171 T5163 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2539257 T5192 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leader_elect/shard1/election
[junit4] 2> 2539350 T5163 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2539481 T5192 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 2539545 T5192 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=5 found=1 timeoutin=179987
[junit4] 2> 2539670 T5163 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2539793 T5147 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2539795 T5147 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2539798 T5147 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2539915 T5187 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2539916 T5187 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2539918 T5187 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2539915 T5160 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2539978 T5160 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2539970 T5137 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2539997 T5160 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2540015 T5163 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2540049 T5154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2540050 T5136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2540054 T5168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2540053 T5141 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2540053 T5211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2540053 T5182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2540056 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2540055 T5213 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2540233 T5163 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2540269 T5163 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2540270 T5163 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2540271 T5163 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2540284 T5163 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2540285 T5163 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2540286 T5163 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2540287 T5163 oasc.SolrCore.<init> [awholynewcollection_0_shard2_replica2] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard2_replica2/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard2_replica2/data/
[junit4] 2> 2540288 T5163 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2540291 T5163 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard2_replica2/data
[junit4] 2> 2540292 T5163 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard2_replica2/data/index/
[junit4] 2> 2540292 T5163 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard2_replica2] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 2540295 T5163 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard2_replica2/data/index
[junit4] 2> 2540318 T5163 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@188b45f2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@33968eda),segFN=segments_1,generation=1}
[junit4] 2> 2540320 T5163 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2540331 T5173 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2540333 T5173 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2540335 T5173 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2540346 T5163 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2540347 T5163 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2540349 T5163 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2540393 T5163 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2540395 T5163 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2540396 T5163 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2540397 T5163 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2540399 T5163 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2540368 T5147 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2540385 T5173 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2540447 T5147 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2540439 T5187 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2540509 T5160 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2540521 T5146 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2540523 T5146 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2540533 T5160 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2540564 T5146 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2540597 T5163 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2540631 T5187 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2540652 T5190 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2540653 T5190 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2540655 T5190 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2540719 T5131 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2540720 T5131 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2540763 T5131 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2540743 T5173 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2540739 T5146 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2540925 T5147 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2540959 T5146 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2540970 T5163 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2540980 T5160 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2541023 T5148 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2541041 T5148 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2541044 T5148 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2541110 T5160 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2541128 T5187 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2541147 T5130 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2541149 T5130 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2541152 T5130 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2541158 T5147 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2541195 T5160 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2541188 T5187 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2541199 T5190 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2541171 T5131 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2541237 T5147 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2541257 T5163 oass.SolrIndexSearcher.<init> Opening Searcher@65fc01d0 main
[junit4] 2> 2541264 T5163 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2541265 T5163 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2541244 T5160 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2541269 T5160 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2541271 T5160 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2541283 T5148 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2541292 T5189 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2541294 T5189 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2541296 T5189 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2541293 T5131 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2541304 T5173 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2541334 T5244 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard2_replica2] Registered new searcher Searcher@65fc01d0 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2541338 T5163 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard2_replica2
[junit4] 2> 2541339 T5163 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard2_replica2 address:http://127.0.0.1:53570/dx_sd collection:awholynewcollection_0 shard:shard2
[junit4] 2> 2541341 T5163 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2541339 T5160 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2541369 T5160 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2541371 T5160 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2541372 T5160 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica2] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard1_replica2/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard1_replica2/data/
[junit4] 2> 2541374 T5160 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2541351 T5147 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2541378 T5147 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2541379 T5147 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2541387 T5160 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard1_replica2/data
[junit4] 2> 2541389 T5160 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard1_replica2/data/index/
[junit4] 2> 2541390 T5160 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard1_replica2] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 2541392 T5160 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard1_replica2/data/index
[junit4] 2> 2541403 T5190 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2541394 T5146 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2541414 T5148 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2541434 T5147 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2541441 T5147 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2541442 T5147 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2541443 T5147 oasc.SolrCore.<init> [awholynewcollection_0_shard3_replica1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard3_replica1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard3_replica1/data/
[junit4] 2> 2541444 T5147 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2541456 T5146 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2541456 T5147 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard3_replica1/data
[junit4] 2> 2541514 T5146 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2541520 T5147 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard3_replica1/data/index/
[junit4] 2> 2541521 T5147 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard3_replica1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard3_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2541523 T5147 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard3_replica1/data/index
[junit4] 2> 2541538 T5187 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2541553 T5187 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2541554 T5187 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2541555 T5187 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2541555 T5189 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2541572 T5187 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2541575 T5187 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2541589 T5187 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2541592 T5187 oasc.SolrCore.<init> [awholynewcollection_0_shard2_replica3] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard2_replica3/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard2_replica3/data/
[junit4] 2> 2541593 T5187 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2541608 T5187 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard2_replica3/data
[junit4] 2> 2541611 T5187 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard2_replica3/data/index/
[junit4] 2> 2541613 T5187 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard2_replica3] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard2_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 2541614 T5187 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard2_replica3/data/index
[junit4] 2> 2541573 T5146 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2541635 T5146 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2541635 T5146 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2541589 T5130 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2541585 T5173 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2541645 T5130 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2541643 T5160 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@254d2581 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3efdd924),segFN=segments_1,generation=1}
[junit4] 2> 2541659 T5160 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2541691 T5190 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2541726 T5160 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2541727 T5160 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2541730 T5160 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2541732 T5160 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2541726 T5146 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2541740 T5146 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2541741 T5146 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2541743 T5146 oasc.SolrCore.<init> [awholynewcollection_0_shard4_replica1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard4_replica1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard4_replica1/data/
[junit4] 2> 2541744 T5146 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2541757 T5146 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard4_replica1/data
[junit4] 2> 2541759 T5146 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard4_replica1/data/index/
[junit4] 2> 2541763 T5146 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard4_replica1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard4_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2541765 T5146 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard4_replica1/data/index
[junit4] 2> 2541760 T5147 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7743ab7c lockFactory=org.apache.lucene.store.NativeFSLockFactory@7f559085),segFN=segments_1,generation=1}
[junit4] 2> 2541771 T5147 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2541782 T5160 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2541783 T5160 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2541785 T5160 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2541787 T5160 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2541794 T5187 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3baba65d lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d7dd96),segFN=segments_1,generation=1}
[junit4] 2> 2541796 T5187 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2541795 T5160 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2541993 T5189 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2541996 T5163 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leader_elect/shard2/election
[junit4] 2> 2542017 T5131 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2542039 T5148 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2542045 T5147 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2542048 T5147 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2542064 T5187 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2542071 T5187 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2542073 T5187 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2542075 T5187 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2542078 T5187 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2542105 T5187 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2542106 T5187 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2542108 T5187 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2542110 T5187 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2542085 T5147 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2542128 T5188 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2542129 T5188 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2542132 T5188 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2542125 T5146 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a6b8a90 lockFactory=org.apache.lucene.store.NativeFSLockFactory@539a9171),segFN=segments_1,generation=1}
[junit4] 2> 2542156 T5146 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2542158 T5173 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2542156 T5148 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2542178 T5190 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2542133 T5131 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2542129 T5147 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2542193 T5147 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2542194 T5147 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2542195 T5147 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2542197 T5147 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2542200 T5147 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2542246 T5163 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 2542235 T5130 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2542209 T5173 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2542302 T5173 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2542304 T5173 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2542309 T5163 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard2: total=5 found=1 timeoutin=179992
[junit4] 2> 2542207 T5146 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2542323 T5146 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2542325 T5146 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2542329 T5128 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2542331 T5128 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2542334 T5128 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2542331 T5173 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2542345 T5173 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2542346 T5173 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2542347 T5173 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica4] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard1_replica4/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard1_replica4/data/
[junit4] 2> 2542349 T5173 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2542354 T5146 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2542356 T5146 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2542407 T5146 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2542409 T5146 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2542410 T5146 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2542411 T5159 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2542411 T5159 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2542412 T5159 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2542392 T5160 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2542435 T5150 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2542436 T5150 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2542438 T5150 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2542391 T5131 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2542367 T5187 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2542365 T5147 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2542362 T5173 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard1_replica4/data
[junit4] 2> 2542455 T5173 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard1_replica4/data/index/
[junit4] 2> 2542455 T5173 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard1_replica4] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard1_replica4/data/index' doesn't exist. Creating new index...
[junit4] 2> 2542456 T5173 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard1_replica4/data/index
[junit4] 2> 2542448 T5160 oass.SolrIndexSearcher.<init> Opening Searcher@29ba2349 main
[junit4] 2> 2542460 T5160 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2542461 T5160 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2542447 T5131 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2542479 T5131 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2542480 T5131 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2542411 T5146 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2542485 T5128 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2542490 T5188 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2542495 T5146 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2542497 T5147 oass.SolrIndexSearcher.<init> Opening Searcher@39df3cf0 main
[junit4] 2> 2542499 T5128 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2542525 T5130 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2542518 T5245 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard1_replica2] Registered new searcher Searcher@29ba2349 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2542535 T5190 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2542512 T5131 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2542538 T5131 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2542539 T5131 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2542540 T5131 oasc.SolrCore.<init> [awholynewcollection_0_shard4_replica5] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard4_replica5/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard4_replica5/data/
[junit4] 2> 2542541 T5131 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2542556 T5177 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2542557 T5177 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2542571 T5177 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2542512 T5159 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2542574 T5190 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2542575 T5190 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2542587 T5177 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2542508 T5150 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2542503 T5189 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2542640 T5161 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2542661 T5161 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2542665 T5161 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2542639 T5147 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2542668 T5147 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2542635 T5188 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2542629 T5146 oass.SolrIndexSearcher.<init> Opening Searcher@769eb75d main
[junit4] 2> 2542674 T5146 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2542675 T5146 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2542628 T5187 oass.SolrIndexSearcher.<init> Opening Searcher@77f72675 main
[junit4] 2> 2542686 T5189 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2542687 T5246 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard3_replica1] Registered new searcher Searcher@39df3cf0 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2542691 T5247 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard4_replica1] Registered new searcher Searcher@769eb75d main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2542693 T5146 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard4_replica1
[junit4] 2> 2542693 T5146 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard4_replica1 address:http://127.0.0.1:53567/dx_sd collection:awholynewcollection_0 shard:shard4
[junit4] 2> 2542704 T5147 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard3_replica1
[junit4] 2> 2542705 T5147 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard3_replica1 address:http://127.0.0.1:53567/dx_sd collection:awholynewcollection_0 shard:shard3
[junit4] 2> 2542706 T5147 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2542624 T5160 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard1_replica2
[junit4] 2> 2542712 T5160 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard1_replica2 address:http://127.0.0.1:53570/dx_sd collection:awholynewcollection_0 shard:shard1
[junit4] 2> 2542712 T5160 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2542603 T5130 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2542719 T5130 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2542720 T5130 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2542721 T5130 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2542726 T5130 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2542727 T5130 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2542728 T5130 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2542730 T5130 oasc.SolrCore.<init> [awholynewcollection_0_shard3_replica5] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard3_replica5/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard3_replica5/data/
[junit4] 2> 2542732 T5130 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2542735 T5130 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard3_replica5/data
[junit4] 2> 2542736 T5130 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard3_replica5/data/index/
[junit4] 2> 2542736 T5130 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard3_replica5] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard3_replica5/data/index' doesn't exist. Creating new index...
[junit4] 2> 2542738 T5130 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard3_replica5/data/index
[junit4] 2> 2542599 T5159 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2542588 T5173 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@27336fcf lockFactory=org.apache.lucene.store.NativeFSLockFactory@7450aecb),segFN=segments_1,generation=1}
[junit4] 2> 2542744 T5173 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2542588 T5190 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2542558 T5131 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard4_replica5/data
[junit4] 2> 2542751 T5131 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard4_replica5/data/index/
[junit4] 2> 2542752 T5131 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard4_replica5] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard4_replica5/data/index' doesn't exist. Creating new index...
[junit4] 2> 2542752 T5131 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard4_replica5/data/index
[junit4] 2> 2542557 T5148 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2542755 T5188 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2542686 T5187 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2542758 T5187 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2542762 T5148 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2542768 T5148 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2542769 T5148 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2542770 T5248 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard2_replica3] Registered new searcher Searcher@77f72675 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2542772 T5187 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard2_replica3
[junit4] 2> 2542775 T5187 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard2_replica3 address:http://127.0.0.1:53576/dx_sd collection:awholynewcollection_0 shard:shard2
[junit4] 2> 2542775 T5187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2542755 T5173 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2542779 T5173 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2542783 T5173 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2542762 T5190 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2542786 T5190 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2542787 T5190 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2542788 T5190 oasc.SolrCore.<init> [awholynewcollection_0_shard4_replica3] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard4_replica3/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard4_replica3/data/
[junit4] 2> 2542789 T5190 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2542786 T5148 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2542792 T5148 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2542801 T5146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2542794 T5173 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2542806 T5173 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2542807 T5173 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2542808 T5173 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2542809 T5173 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2542810 T5173 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2542802 T5190 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard4_replica3/data
[junit4] 2> 2542802 T5148 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2542824 T5148 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard1_replica1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard1_replica1/data/
[junit4] 2> 2542825 T5148 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2542827 T5190 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard4_replica3/data/index/
[junit4] 2> 2542828 T5190 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard4_replica3] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard4_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 2542829 T5190 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard4_replica3/data/index
[junit4] 2> 2542834 T5127 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2542835 T5127 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2542838 T5127 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2542839 T5148 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard1_replica1/data
[junit4] 2> 2542840 T5148 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard1_replica1/data/index/
[junit4] 2> 2542841 T5148 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard1_replica1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2542842 T5148 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard1_replica1/data/index
[junit4] 2> 2542855 T5130 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2215d464 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c71814b),segFN=segments_1,generation=1}
[junit4] 2> 2542856 T5130 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2542898 T5164 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2542900 T5164 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2542902 T5164 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2542912 T5177 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2542916 T5131 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@29b9afde lockFactory=org.apache.lucene.store.NativeFSLockFactory@37c85ee6),segFN=segments_1,generation=1}
[junit4] 2> 2542917 T5131 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2542931 T5190 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@36b0db12 lockFactory=org.apache.lucene.store.NativeFSLockFactory@324ae943),segFN=segments_1,generation=1}
[junit4] 2> 2542932 T5190 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2542946 T5131 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2542986 T5131 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2542988 T5131 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2542989 T5131 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2542999 T5128 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2543019 T5131 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2543020 T5131 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2543021 T5131 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2542969 T5190 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2543030 T5147 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leader_elect/shard3/election
[junit4] 2> 2542961 T5150 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2543030 T5190 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2543058 T5190 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2543060 T5190 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2543062 T5148 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@74a97d65 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f44ac84),segFN=segments_1,generation=1}
[junit4] 2> 2543063 T5148 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2543072 T5173 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2543079 T5146 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leader_elect/shard4/election
[junit4] 2> 2543023 T5131 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2543083 T5131 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2543084 T5130 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2543086 T5130 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2543088 T5130 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2543091 T5130 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2543092 T5130 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2543093 T5130 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2543095 T5190 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2543096 T5190 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2543122 T5190 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2543158 T5147 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 2543092 T5174 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2543160 T5174 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2543162 T5174 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2543159 T5190 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2543169 T5190 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2543172 T5175 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2543173 T5175 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2543177 T5175 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2543158 T5177 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2543157 T5189 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2543156 T5127 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2543138 T5137 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2543204 T5148 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2543219 T5148 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2543221 T5148 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2543223 T5148 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2543224 T5148 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2543225 T5148 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2543226 T5148 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2543227 T5148 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2543228 T5148 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2543232 T5146 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard4
[junit4] 2> 2543132 T5128 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2543129 T5159 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2543249 T5239 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=5&maxShardsPerNode=6&name=awholynewcollection_0&replicationFactor=5&action=CREATE&wt=javabin&version=2
[junit4] 2> 2543253 T5136 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2543096 T5130 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2543256 T5173 oass.SolrIndexSearcher.<init> Opening Searcher@6f85d629 main
[junit4] 2> 2543260 T5146 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard4: total=5 found=1 timeoutin=179995
[junit4] 2> 2543218 T5147 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard3: total=5 found=1 timeoutin=179989
[junit4] 2> 2543214 T5189 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2543262 T5189 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2543263 T5189 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2543174 T5190 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2543259 T5130 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2543270 T5130 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2543275 T5148 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2543278 T5189 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2543279 T5189 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2543280 T5189 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2543281 T5189 oasc.SolrCore.<init> [awholynewcollection_0_shard3_replica3] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard3_replica3/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard3_replica3/data/
[junit4] 2> 2543282 T5189 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2543287 T5189 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard3_replica3/data
[junit4] 2> 2543288 T5189 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard3_replica3/data/index/
[junit4] 2> 2543289 T5189 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard3_replica3] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard3_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 2543289 T5188 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2543289 T5189 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard3_replica3/data/index
[junit4] 2> 2543297 T5127 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2543312 T5161 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2543323 T5164 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2543377 T5177 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2543379 T5130 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2543386 T5190 oass.SolrIndexSearcher.<init> Opening Searcher@20d072d3 main
[junit4] 2> 2543388 T5148 oass.SolrIndexSearcher.<init> Opening Searcher@33d09886 main
[junit4] 2> 2543390 T5190 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2543391 T5190 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2543392 T5148 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2543401 T5148 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2543399 T5131 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2543409 T5159 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2543397 T5173 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2543469 T5173 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2543416 T5128 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2543491 T5161 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2543493 T5188 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2543491 T5174 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2543589 T5252 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard1_replica1] Registered new searcher Searcher@33d09886 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2543609 T5174 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2543610 T5177 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2543614 T5251 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard4_replica3] Registered new searcher Searcher@20d072d3 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2543617 T5190 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard4_replica3
[junit4] 2> 2543617 T5190 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard4_replica3 address:http://127.0.0.1:53576/dx_sd collection:awholynewcollection_0 shard:shard4
[junit4] 2> 2543618 T5190 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2543634 T5189 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9d0ed2d lockFactory=org.apache.lucene.store.NativeFSLockFactory@24090efb),segFN=segments_1,generation=1}
[junit4] 2> 2543635 T5189 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2543587 T5132 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2543656 T5132 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2543658 T5132 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2543675 T5132 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2543681 T5132 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2543691 T5148 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard1_replica1
[junit4] 2> 2543692 T5148 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard1_replica1 address:http://127.0.0.1:53567/dx_sd collection:awholynewcollection_0 shard:shard1
[junit4] 2> 2543692 T5148 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2543693 T5150 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2543516 T5131 oass.SolrIndexSearcher.<init> Opening Searcher@2ec414e7 main
[junit4] 2> 2543696 T5131 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2543697 T5131 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2543515 T5164 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2543510 T5175 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2543713 T5175 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2543510 T5130 oass.SolrIndexSearcher.<init> Opening Searcher@77135c2c main
[junit4] 2> 2543719 T5130 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2543729 T5130 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2543505 T5173 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard1_replica4
[junit4] 2> 2543733 T5173 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard1_replica4 address:http://127.0.0.1:53573/dx_sd collection:awholynewcollection_0 shard:shard1
[junit4] 2> 2543497 T5249 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard1_replica4] Registered new searcher Searcher@6f85d629 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2543735 T5173 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2543727 T5189 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2543724 T5253 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard4_replica5] Registered new searcher Searcher@2ec414e7 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2543739 T5189 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2543745 T5189 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2543748 T5189 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2543751 T5189 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2543752 T5189 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2543755 T5189 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2543764 T5189 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2543766 T5189 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2543752 T5131 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard4_replica5
[junit4] 2> 2543769 T5131 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard4_replica5 address:http://127.0.0.1:53563/dx_sd collection:awholynewcollection_0 shard:shard4
[junit4] 2> 2543770 T5131 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2543773 T5254 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard3_replica5] Registered new searcher Searcher@77135c2c main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2543774 T5130 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard3_replica5
[junit4] 2> 2543910 T5130 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard3_replica5 address:http://127.0.0.1:53563/dx_sd collection:awholynewcollection_0 shard:shard3
[junit4] 2> 2543910 T5130 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2543887 T5188 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2543883 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2543881 T5182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2543881 T5141 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2543917 T5188 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2543917 T5188 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2543787 T5159 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2543955 T5213 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2543956 T5211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2543956 T5168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2543957 T5154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2543959 T5136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2543959 T5177 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2543960 T5177 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2543961 T5177 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2543959 T5128 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2543962 T5128 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2543962 T5128 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2543995 T5150 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2544117 T5188 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2544117 T5188 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2544118 T5188 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2544119 T5188 oasc.SolrCore.<init> [awholynewcollection_0_shard5_replica3] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard5_replica3/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard5_replica3/data/
[junit4] 2> 2544120 T5188 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2544121 T5159 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2544121 T5188 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard5_replica3/data
[junit4] 2> 2544123 T5188 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard5_replica3/data/index/
[junit4] 2> 2544123 T5188 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard5_replica3] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939/awholynewcollection_0_shard5_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 2544124 T5188 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard5_replica3/data/index
[junit4] 2> 2544125 T5159 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2544126 T5159 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2544129 T5128 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2544129 T5128 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2544130 T5128 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2544131 T5128 oasc.SolrCore.<init> [awholynewcollection_0_shard2_replica5] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard2_replica5/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard2_replica5/data/
[junit4] 2> 2544131 T5128 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2544137 T5128 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard2_replica5/data
[junit4] 2> 2544137 T5128 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard2_replica5/data/index/
[junit4] 2> 2544138 T5128 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard2_replica5] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard2_replica5/data/index' doesn't exist. Creating new index...
[junit4] 2> 2544139 T5128 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard2_replica5/data/index
[junit4] 2> 2544142 T5159 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2544144 T5159 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2544144 T5159 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2544145 T5159 oasc.SolrCore.<init> [awholynewcollection_0_shard4_replica2] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard4_replica2/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard4_replica2/data/
[junit4] 2> 2544147 T5159 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2544149 T5159 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard4_replica2/data
[junit4] 2> 2544150 T5159 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard4_replica2/data/index/
[junit4] 2> 2544151 T5159 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard4_replica2] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard4_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 2544152 T5159 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard4_replica2/data/index
[junit4] 2> 2544158 T5177 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2544159 T5177 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2544160 T5177 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2544160 T5177 oasc.SolrCore.<init> [awholynewcollection_0_shard3_replica4] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard3_replica4/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard3_replica4/data/
[junit4] 2> 2544161 T5177 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2544162 T5177 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard3_replica4/data
[junit4] 2> 2544163 T5177 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard3_replica4/data/index/
[junit4] 2> 2544164 T5177 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard3_replica4] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard3_replica4/data/index' doesn't exist. Creating new index...
[junit4] 2> 2544164 T5177 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard3_replica4/data/index
[junit4] 2> 2544189 T5150 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2544202 T5128 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4f38b12d lockFactory=org.apache.lucene.store.NativeFSLockFactory@11f9e0f),segFN=segments_1,generation=1}
[junit4] 2> 2544203 T5128 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2544212 T5128 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2544225 T5128 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2544227 T5128 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2544228 T5128 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2544229 T5128 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2544230 T5128 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2544230 T5128 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2544224 T5189 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2544240 T5150 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2544244 T5150 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2544245 T5150 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2544247 T5149 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2544247 T5149 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2544249 T5149 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2544251 T5128 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2544252 T5128 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2544268 T5128 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2544358 T5174 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2544357 T5175 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2544327 T5132 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2544319 T5164 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2544315 T5127 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2544315 T5161 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2544285 T5150 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2544373 T5150 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2544373 T5150 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2544374 T5150 oasc.SolrCore.<init> [awholynewcollection_0_shard5_replica1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard5_replica1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard5_replica1/data/
[junit4] 2> 2544374 T5150 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2544282 T5159 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2c4b7f8f lockFactory=org.apache.lucene.store.NativeFSLockFactory@366463a3),segFN=segments_1,generation=1}
[junit4] 2> 2544377 T5159 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2544282 T5188 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@460c679a lockFactory=org.apache.lucene.store.NativeFSLockFactory@3a231b91),segFN=segments_1,generation=1}
[junit4] 2> 2544378 T5188 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2544395 T5150 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard5_replica1/data
[junit4] 2> 2544396 T5150 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard5_replica1/data/index/
[junit4] 2> 2544396 T5150 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard5_replica1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard5_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2544397 T5150 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard5_replica1/data/index
[junit4] 2> 2544404 T5188 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2544405 T5188 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2544407 T5188 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2544418 T5159 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2544419 T5159 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2544420 T5159 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2544439 T5161 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2544446 T5127 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2544455 T5161 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2544462 T5127 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2544467 T5161 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2544468 T5161 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2544469 T5161 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2544470 T5127 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2544471 T5127 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2544471 T5127 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2544475 T5161 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2544476 T5161 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2544476 T5161 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2544477 T5161 oasc.SolrCore.<init> [awholynewcollection_0_shard5_replica2] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard5_replica2/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard5_replica2/data/
[junit4] 2> 2544478 T5161 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2544480 T5127 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2544481 T5127 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2544481 T5127 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2544482 T5127 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica5] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard1_replica5/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard1_replica5/data/
[junit4] 2> 2544483 T5127 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2544486 T5164 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2544489 T5161 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard5_replica2/data
[junit4] 2> 2544494 T5127 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard1_replica5/data
[junit4] 2> 2544495 T5127 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard1_replica5/data/index/
[junit4] 2> 2544496 T5127 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard1_replica5] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard1_replica5/data/index' doesn't exist. Creating new index...
[junit4] 2> 2544496 T5127 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard1_replica5/data/index
[junit4] 2> 2544497 T5150 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5cb50451 lockFactory=org.apache.lucene.store.NativeFSLockFactory@704adfe2),segFN=segments_1,generation=1}
[junit4] 2> 2544498 T5150 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2544499 T5164 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2544500 T5161 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard5_replica2/data/index/
[junit4] 2> 2544501 T5161 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard5_replica2] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard5_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 2544502 T5161 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard5_replica2/data/index
[junit4] 2> 2544504 T5164 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2544504 T5164 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2544505 T5164 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2544507 T5164 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2544686 T5164 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2544687 T5164 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2544687 T5164 oasc.SolrCore.<init> [awholynewcollection_0_shard3_replica2] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard3_replica2/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard3_replica2/data/
[junit4] 2> 2544688 T5164 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2544690 T5150 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2544691 T5150 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2544692 T5150 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2544693 T5150 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2544694 T5150 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2544695 T5150 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2544696 T5150 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2544697 T5150 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2544698 T5150 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2544708 T5189 oass.SolrIndexSearcher.<init> Opening Searcher@1574b4bc main
[junit4] 2> 2544712 T5189 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2544713 T5189 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2544282 T5149 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2544278 T5177 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6d75d85 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3ea1f905),segFN=segments_1,generation=1}
[junit4] 2> 2544724 T5177 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2544722 T5188 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2544736 T5188 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2544737 T5188 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2544737 T5188 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2544739 T5188 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2544740 T5188 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2544760 T5177 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2544761 T5177 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2544763 T5177 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2544764 T5177 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2544708 T5164 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard3_replica2/data
[junit4] 2> 2544766 T5164 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard3_replica2/data/index/
[junit4] 2> 2544767 T5164 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard3_replica2] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480/awholynewcollection_0_shard3_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 2544768 T5164 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard3_replica2/data/index
[junit4] 2> 2544685 T5159 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2544770 T5159 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2544771 T5159 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2544771 T5159 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2544773 T5159 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2544773 T5159 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2544777 T5174 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2544779 T5177 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2544780 T5177 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2544780 T5177 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2544782 T5255 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard3_replica3] Registered new searcher Searcher@1574b4bc main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2544785 T5177 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2544786 T5177 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2544781 T5132 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2544789 T5159 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2544791 T5188 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2544787 T5161 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@28e10391 lockFactory=org.apache.lucene.store.NativeFSLockFactory@60abdd7c),segFN=segments_1,generation=1}
[junit4] 2> 2544797 T5161 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2544786 T5189 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard3_replica3
[junit4] 2> 2544799 T5189 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard3_replica3 address:http://127.0.0.1:53576/dx_sd collection:awholynewcollection_0 shard:shard3
[junit4] 2> 2544800 T5128 oass.SolrIndexSearcher.<init> Opening Searcher@6a68653b main
[junit4] 2> 2544803 T5128 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2544803 T5128 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2544805 T5127 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5b268c7f lockFactory=org.apache.lucene.store.NativeFSLockFactory@7dbb2139),segFN=segments_1,generation=1}
[junit4] 2> 2544806 T5127 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2544806 T5189 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2544830 T5177 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2544838 T5127 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2544839 T5127 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2544840 T5127 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2544859 T5175 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2544857 T5174 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2544848 T5150 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2544845 T5159 oass.SolrIndexSearcher.<init> Opening Searcher@2a4ffe80 main
[junit4] 2> 2544874 T5164 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2cc10062 lockFactory=org.apache.lucene.store.NativeFSLockFactory@43ba23b9),segFN=segments_1,generation=1}
[junit4] 2> 2544877 T5164 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2544877 T5159 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2544878 T5159 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2544861 T5127 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2544886 T5127 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2544887 T5127 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2544887 T5127 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2544891 T5127 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2544892 T5127 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2544876 T5149 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2544899 T5161 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2544900 T5161 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2544901 T5161 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2544903 T5161 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2544904 T5161 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2544905 T5161 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2544906 T5161 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2544907 T5161 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2544908 T5161 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2544910 T5164 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2544911 T5164 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2544912 T5164 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2544888 T5188 oass.SolrIndexSearcher.<init> Opening Searcher@14740c1b main
[junit4] 2> 2544905 T5256 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard2_replica5] Registered new searcher Searcher@6a68653b main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2544915 T5188 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2544915 T5188 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2544919 T5128 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard2_replica5
[junit4] 2> 2544920 T5128 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard2_replica5 address:http://127.0.0.1:53563/dx_sd collection:awholynewcollection_0 shard:shard2
[junit4] 2> 2544922 T5164 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2544924 T5164 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2544924 T5164 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2544925 T5164 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2544921 T5128 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2544931 T5258 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard5_replica3] Registered new searcher Searcher@14740c1b main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2544934 T5188 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard5_replica3
[junit4] 2> 2544935 T5188 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard5_replica3 address:http://127.0.0.1:53576/dx_sd collection:awholynewcollection_0 shard:shard5
[junit4] 2> 2544936 T5188 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2544946 T5174 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2544946 T5174 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2544947 T5174 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2544954 T5132 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2544968 T5174 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2544969 T5174 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2544970 T5174 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2544971 T5174 oasc.SolrCore.<init> [awholynewcollection_0_shard2_replica4] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard2_replica4/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard2_replica4/data/
[junit4] 2> 2544971 T5174 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2544982 T5132 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2544984 T5132 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2544984 T5132 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2544983 T5174 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard2_replica4/data
[junit4] 2> 2544985 T5174 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard2_replica4/data/index/
[junit4] 2> 2544986 T5174 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard2_replica4] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard2_replica4/data/index' doesn't exist. Creating new index...
[junit4] 2> 2544987 T5174 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard2_replica4/data/index
[junit4] 2> 2544990 T5161 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2545007 T5132 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2545018 T5132 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2545018 T5132 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2545019 T5132 oasc.SolrCore.<init> [awholynewcollection_0_shard5_replica5] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard5_replica5/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard5_replica5/data/
[junit4] 2> 2545020 T5132 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2545025 T5150 oass.SolrIndexSearcher.<init> Opening Searcher@4c859927 main
[junit4] 2> 2545027 T5150 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2545027 T5150 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2545032 T5132 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard5_replica5/data
[junit4] 2> 2545032 T5132 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard5_replica5/data/index/
[junit4] 2> 2545033 T5132 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard5_replica5] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293/awholynewcollection_0_shard5_replica5/data/index' doesn't exist. Creating new index...
[junit4] 2> 2545034 T5132 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard5_replica5/data/index
[junit4] 2> 2545035 T5159 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard4_replica2
[junit4] 2> 2545036 T5159 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard4_replica2 address:http://127.0.0.1:53570/dx_sd collection:awholynewcollection_0 shard:shard4
[junit4] 2> 2545037 T5159 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2545043 T5175 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2545007 T5164 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2545045 T5164 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2545049 T5164 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2545050 T5176 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2545051 T5176 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 2545053 T5176 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2545058 T5260 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard5_replica1] Registered new searcher Searcher@4c859927 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2545061 T5150 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard5_replica1
[junit4] 2> 2545062 T5150 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard5_replica1 address:http://127.0.0.1:53567/dx_sd collection:awholynewcollection_0 shard:shard5
[junit4] 2> 2545063 T5127 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2545003 T5177 oass.SolrIndexSearcher.<init> Opening Searcher@6ca15a5a main
[junit4] 2> 2545063 T5150 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2545069 T5177 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2545036 T5257 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard4_replica2] Registered new searcher Searcher@2a4ffe80 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2545083 T5177 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2545066 T5161 oass.SolrIndexSearcher.<init> Opening Searcher@2498c059 main
[junit4] 2> 2545087 T5161 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2545087 T5161 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2545066 T5175 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2545091 T5175 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2545091 T5175 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2545093 T5175 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2545093 T5175 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2545094 T5175 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2545094 T5175 oasc.SolrCore.<init> [awholynewcollection_0_shard5_replica4] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard5_replica4/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard5_replica4/data/
[junit4] 2> 2545095 T5175 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2545103 T5150 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leader_elect/shard5/election
[junit4] 2> 2545107 T5175 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard5_replica4/data
[junit4] 2> 2545108 T5175 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard5_replica4/data/index/
[junit4] 2> 2545108 T5175 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard5_replica4] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard5_replica4/data/index' doesn't exist. Creating new index...
[junit4] 2> 2545109 T5175 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard5_replica4/data/index
[junit4] 2> 2545163 T5261 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard5_replica2] Registered new searcher Searcher@2498c059 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2545166 T5259 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard3_replica4] Registered new searcher Searcher@6ca15a5a main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2545170 T5161 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard5_replica2
[junit4] 2> 2545171 T5177 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard3_replica4
[junit4] 2> 2545171 T5177 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard3_replica4 address:http://127.0.0.1:53573/dx_sd collection:awholynewcollection_0 shard:shard3
[junit4] 2> 2545171 T5161 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard5_replica2 address:http://127.0.0.1:53570/dx_sd collection:awholynewcollection_0 shard:shard5
[junit4] 2> 2545173 T5161 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2545172 T5177 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2545180 T5174 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@617e553c lockFactory=org.apache.lucene.store.NativeFSLockFactory@3ce9360e),segFN=segments_1,generation=1}
[junit4] 2> 2545181 T5174 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2545183 T5127 oass.SolrIndexSearcher.<init> Opening Searcher@6d33479d main
[junit4] 2> 2545185 T5127 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2545186 T5127 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2545173 T5164 oass.SolrIndexSearcher.<init> Opening Searcher@7b0ce493 main
[junit4] 2> 2545195 T5164 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2545196 T5164 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2545204 T5263 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard1_replica5] Registered new searcher Searcher@6d33479d main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2545211 T5127 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard1_replica5
[junit4] 2> 2545212 T5127 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard1_replica5 address:http://127.0.0.1:53563/dx_sd collection:awholynewcollection_0 shard:shard1
[junit4] 2> 2545213 T5127 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2545215 T5174 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2545215 T5174 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2545235 T5174 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2545236 T5174 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2545237 T5174 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2545238 T5174 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2545241 T5174 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2545242 T5174 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2545243 T5174 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2545229 T5164 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard3_replica2
[junit4] 2> 2545246 T5164 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard3_replica2 address:http://127.0.0.1:53570/dx_sd collection:awholynewcollection_0 shard:shard3
[junit4] 2> 2545247 T5164 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2545226 T5132 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@130ed264 lockFactory=org.apache.lucene.store.NativeFSLockFactory@10cdfd7c),segFN=segments_1,generation=1}
[junit4] 2> 2545251 T5132 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2545257 T5176 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2545224 T5188 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leader_elect/shard5/election
[junit4] 2> 2545217 T5262 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard3_replica2] Registered new searcher Searcher@7b0ce493 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2545317 T5150 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard5
[junit4] 2> 2545297 T5174 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2545282 T5132 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2545333 T5132 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2545335 T5132 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2545336 T5132 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2545281 T5175 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@30d11bf3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f9fd6d3),segFN=segments_1,generation=1}
[junit4] 2> 2545337 T5175 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2545326 T5149 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2545347 T5132 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2545347 T5132 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2545355 T5176 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2545356 T5175 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2545357 T5175 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2545358 T5175 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2545359 T5175 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2545360 T5175 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2545361 T5175 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2545362 T5175 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2545363 T5175 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2545364 T5175 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2545368 T5132 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2545369 T5132 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2545370 T5132 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2545386 T5175 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2545403 T5150 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard5: total=5 found=2 timeoutin=179983
[junit4] 2> 2545411 T5149 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2545418 T5175 oass.SolrIndexSearcher.<init> Opening Searcher@52e095f9 main
[junit4] 2> 2545426 T5175 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2545426 T5175 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2545423 T5149 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2545431 T5265 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard5_replica4] Registered new searcher Searcher@52e095f9 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2545420 T5132 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2545435 T5175 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard5_replica4
[junit4] 2> 2545435 T5175 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard5_replica4 address:http://127.0.0.1:53573/dx_sd collection:awholynewcollection_0 shard:shard5
[junit4] 2> 2545436 T5175 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2545445 T5174 oass.SolrIndexSearcher.<init> Opening Searcher@296065a3 main
[junit4] 2> 2545448 T5174 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2545449 T5174 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2545460 T5149 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2545462 T5149 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2545463 T5149 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2545475 T5264 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard2_replica4] Registered new searcher Searcher@296065a3 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2545475 T5132 oass.SolrIndexSearcher.<init> Opening Searcher@4c755595 main
[junit4] 2> 2545477 T5174 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard2_replica4
[junit4] 2> 2545477 T5174 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard2_replica4 address:http://127.0.0.1:53573/dx_sd collection:awholynewcollection_0 shard:shard2
[junit4] 2> 2545478 T5174 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2545477 T5132 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2545484 T5132 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2545488 T5149 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2545494 T5149 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2545495 T5149 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2545495 T5149 oasc.SolrCore.<init> [awholynewcollection_0_shard2_replica1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard2_replica1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard2_replica1/data/
[junit4] 2> 2545496 T5149 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2545500 T5266 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard5_replica5] Registered new searcher Searcher@4c755595 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2545500 T5147 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2545502 T5147 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 2545502 T5147 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard3_replica1/
[junit4] 2> 2545503 T5147 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard3_replica1 url=http://127.0.0.1:53567/dx_sd START replicas=[http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard3_replica2/, http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard3_replica3/, http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard3_replica4/, http://127.0.0.1:53563/dx_sd/awholynewcollection_0_shard3_replica5/] nUpdates=100
[junit4] 2> 2545505 T5147 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard3_replica1 url=http://127.0.0.1:53567/dx_sd DONE. We have no versions. sync failed.
[junit4] 2> 2545506 T5147 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2545506 T5147 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2545507 T5147 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard3_replica1/ shard3
[junit4] 2> 2545508 T5147 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leaders/shard3
[junit4] 2> ASYNC NEW_CORE C1184 name=awholynewcollection_0_shard3_replica4 org.apache.solr.core.SolrCore@747e4fc9 url=http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard3_replica4 node=127.0.0.1:53573_dx_sd C1184_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard3_replica4 props:{state=down, core=awholynewcollection_0_shard3_replica4, node_name=127.0.0.1:53573_dx_sd, base_url=http://127.0.0.1:53573/dx_sd}
[junit4] 2> 2545537 T5240 C1184 P53573 oasc.SolrCore.execute [awholynewcollection_0_shard3_replica4] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=16
[junit4] 2> 2545542 T5149 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard2_replica1/data
[junit4] 2> 2545544 T5149 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard2_replica1/data/index/
[junit4] 2> 2545572 T5132 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard5_replica5
[junit4] 2> 2545573 T5132 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard5_replica5 address:http://127.0.0.1:53563/dx_sd collection:awholynewcollection_0 shard:shard5
[junit4] 2> 2545575 T5132 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> ASYNC NEW_CORE C1185 name=awholynewcollection_0_shard3_replica3 org.apache.solr.core.SolrCore@7fc38e50 url=http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard3_replica3 node=127.0.0.1:53576_dx_sd C1185_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard3_replica3 props:{state=down, core=awholynewcollection_0_shard3_replica3, node_name=127.0.0.1:53576_dx_sd, base_url=http://127.0.0.1:53576/dx_sd}
[junit4] 2> 2545560 T5191 C1185 P53576 oasc.SolrCore.execute [awholynewcollection_0_shard3_replica3] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=2
[junit4] 2> ASYNC NEW_CORE C1186 name=awholynewcollection_0_shard3_replica2 org.apache.solr.core.SolrCore@72dac7b url=http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard3_replica2 node=127.0.0.1:53570_dx_sd C1186_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard3_replica2 props:{state=down, core=awholynewcollection_0_shard3_replica2, node_name=127.0.0.1:53570_dx_sd, base_url=http://127.0.0.1:53570/dx_sd}
[junit4] 2> 2545546 T5162 C1186 P53570 oasc.SolrCore.execute [awholynewcollection_0_shard3_replica2] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=2
[junit4] 2> 2545578 T5149 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard2_replica1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462/awholynewcollection_0_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> ASYNC NEW_CORE C1187 name=awholynewcollection_0_shard3_replica5 org.apache.solr.core.SolrCore@6ab81731 url=http://127.0.0.1:53563/dx_sd/awholynewcollection_0_shard3_replica5 node=127.0.0.1:53563_dx_sd C1187_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard3_replica5 props:{state=down, core=awholynewcollection_0_shard3_replica5, node_name=127.0.0.1:53563_dx_sd, base_url=http://127.0.0.1:53563/dx_sd}
[junit4] 2> 2545584 T5129 C1187 P53563 oasc.SolrCore.execute [awholynewcollection_0_shard3_replica5] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=7
[junit4] 2> 2545584 T5149 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard2_replica1/data/index
[junit4] 2> 2545610 T5149 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7a4c7a36 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f2b9ec),segFN=segments_1,generation=1}
[junit4] 2> 2545611 T5149 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2545619 T5176 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2545627 T5149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2545628 T5149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2545630 T5149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2545644 T5149 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2545646 T5149 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2545647 T5149 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2545669 T5137 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2545673 T5149 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2545677 T5149 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2545680 T5149 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2545706 T5176 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2545723 T5149 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2545740 T5192 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2545741 T5192 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 2545743 T5192 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard1_replica3/
[junit4] 2> 2545744 T5192 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard1_replica3 url=http://127.0.0.1:53576/dx_sd START replicas=[http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard1_replica1/, http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard1_replica4/, http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard1_replica2/, http://127.0.0.1:53563/dx_sd/awholynewcollection_0_shard1_replica5/] nUpdates=100
[junit4] 2> 2545745 T5176 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2545746 T5136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2545747 T5213 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2545748 T5211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2545748 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2545749 T5168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2545755 T5141 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2545759 T5154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2545768 T5192 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard1_replica3 url=http://127.0.0.1:53576/dx_sd DONE. We have no versions. sync failed.
[junit4] 2> 2545771 T5192 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2545773 T5192 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2545774 T5192 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard1_replica3/ shard1
[junit4] 2> 2545776 T5192 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leaders/shard1
[junit4] 2> ASYNC NEW_CORE C1188 name=awholynewcollection_0_shard1_replica1 org.apache.solr.core.SolrCore@2cfe4db7 url=http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard1_replica1 node=127.0.0.1:53567_dx_sd C1188_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard1_replica1 props:{state=down, core=awholynewcollection_0_shard1_replica1, node_name=127.0.0.1:53567_dx_sd, base_url=http://127.0.0.1:53567/dx_sd}
[junit4] 2> 2545786 T5145 C1188 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard1_replica1] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=9
[junit4] 2> 2545800 T5182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2545802 T5149 oass.SolrIndexSearcher.<init> Opening Searcher@2e4fcac3 main
[junit4] 2> ASYNC NEW_CORE C1189 name=awholynewcollection_0_shard1_replica2 org.apache.solr.core.SolrCore@5065ea69 url=http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard1_replica2 node=127.0.0.1:53570_dx_sd C1189_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard1_replica2 props:{state=down, core=awholynewcollection_0_shard1_replica2, node_name=127.0.0.1:53570_dx_sd, base_url=http://127.0.0.1:53570/dx_sd}
[junit4] 2> 2545817 T5162 C1189 P53570 oasc.SolrCore.execute [awholynewcollection_0_shard1_replica2] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> ASYNC NEW_CORE C1190 name=awholynewcollection_0_shard1_replica4 org.apache.solr.core.SolrCore@6a9f136 url=http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard1_replica4 node=127.0.0.1:53573_dx_sd C1190_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard1_replica4 props:{state=down, core=awholynewcollection_0_shard1_replica4, node_name=127.0.0.1:53573_dx_sd, base_url=http://127.0.0.1:53573/dx_sd}
[junit4] 2> 2545817 T5240 C1190 P53573 oasc.SolrCore.execute [awholynewcollection_0_shard1_replica4] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2545825 T5149 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2545826 T5149 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> ASYNC NEW_CORE C1191 name=awholynewcollection_0_shard1_replica5 org.apache.solr.core.SolrCore@5e80bc2d url=http://127.0.0.1:53563/dx_sd/awholynewcollection_0_shard1_replica5 node=127.0.0.1:53563_dx_sd C1191_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard1_replica5 props:{state=down, core=awholynewcollection_0_shard1_replica5, node_name=127.0.0.1:53563_dx_sd, base_url=http://127.0.0.1:53563/dx_sd}
[junit4] 2> 2545830 T5129 C1191 P53563 oasc.SolrCore.execute [awholynewcollection_0_shard1_replica5] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2545850 T5275 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard2_replica1] Registered new searcher Searcher@2e4fcac3 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2545854 T5149 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard2_replica1
[junit4] 2> 2545856 T5149 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard2_replica1 address:http://127.0.0.1:53567/dx_sd collection:awholynewcollection_0 shard:shard2
[junit4] 2> 2545857 T5149 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2545861 T5176 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2545862 T5176 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2545863 T5176 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2545870 T5147 oasc.ZkController.register We are http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard3_replica1/ and leader is http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard3_replica1/
[junit4] 2> 2545875 T5147 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard3_replica1 baseURL=http://127.0.0.1:53567/dx_sd
[junit4] 2> 2545876 T5147 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2545877 T5147 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica1 state=active
[junit4] 2> 2545881 T5176 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2545883 T5176 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2545884 T5176 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2545885 T5176 oasc.SolrCore.<init> [awholynewcollection_0_shard4_replica4] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard4_replica4/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard4_replica4/data/
[junit4] 2> 2545887 T5176 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bc4a53
[junit4] 2> 2545891 T5176 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard4_replica4/data
[junit4] 2> 2545897 T5176 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard4_replica4/data/index/
[junit4] 2> 2545899 T5176 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard4_replica4] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597/awholynewcollection_0_shard4_replica4/data/index' doesn't exist. Creating new index...
[junit4] 2> 2545900 T5147 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2545901 T5176 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard4_replica4/data/index
[junit4] 2> 2545905 T5147 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard3&name=awholynewcollection_0_shard3_replica1&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=32576
[junit4] 2> 2545912 T5150 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2545914 T5150 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 2545916 T5150 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1/
[junit4] 2> 2545917 T5150 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard5_replica1 url=http://127.0.0.1:53567/dx_sd START replicas=[http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard5_replica3/, http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard5_replica2/, http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard5_replica4/, http://127.0.0.1:53563/dx_sd/awholynewcollection_0_shard5_replica5/] nUpdates=100
[junit4] 2> 2545916 T5176 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3cc3b25d lockFactory=org.apache.lucene.store.NativeFSLockFactory@c1da472),segFN=segments_1,generation=1}
[junit4] 2> ASYNC NEW_CORE C1192 name=awholynewcollection_0_shard5_replica3 org.apache.solr.core.SolrCore@6234709d url=http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard5_replica3 node=127.0.0.1:53576_dx_sd C1192_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard5_replica3 props:{state=down, core=awholynewcollection_0_shard5_replica3, node_name=127.0.0.1:53576_dx_sd, base_url=http://127.0.0.1:53576/dx_sd}
[junit4] 2> 2545939 T5191 C1192 P53576 oasc.SolrCore.execute [awholynewcollection_0_shard5_replica3] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2545943 T5176 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> ASYNC NEW_CORE C1193 name=awholynewcollection_0_shard5_replica2 org.apache.solr.core.SolrCore@2a25a35b url=http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard5_replica2 node=127.0.0.1:53570_dx_sd C1193_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard5_replica2 props:{state=down, core=awholynewcollection_0_shard5_replica2, node_name=127.0.0.1:53570_dx_sd, base_url=http://127.0.0.1:53570/dx_sd}
[junit4] 2> 2545949 T5162 C1193 P53570 oasc.SolrCore.execute [awholynewcollection_0_shard5_replica2] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2545923 T5150 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard5_replica1 url=http://127.0.0.1:53567/dx_sd DONE. We have no versions. sync failed.
[junit4] 2> 2545951 T5150 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2545951 T5150 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2545952 T5150 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1/ shard5
[junit4] 2> 2545952 T5150 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leaders/shard5
[junit4] 2> ASYNC NEW_CORE C1194 name=awholynewcollection_0_shard5_replica5 org.apache.solr.core.SolrCore@7e46dce url=http://127.0.0.1:53563/dx_sd/awholynewcollection_0_shard5_replica5 node=127.0.0.1:53563_dx_sd C1194_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard5_replica5 props:{state=down, core=awholynewcollection_0_shard5_replica5, node_name=127.0.0.1:53563_dx_sd, base_url=http://127.0.0.1:53563/dx_sd}
[junit4] 2> 2545982 T5129 C1194 P53563 oasc.SolrCore.execute [awholynewcollection_0_shard5_replica5] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> ASYNC NEW_CORE C1195 name=awholynewcollection_0_shard5_replica4 org.apache.solr.core.SolrCore@5d5818cf url=http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard5_replica4 node=127.0.0.1:53573_dx_sd C1195_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard5_replica4 props:{state=down, core=awholynewcollection_0_shard5_replica4, node_name=127.0.0.1:53573_dx_sd, base_url=http://127.0.0.1:53573/dx_sd}
[junit4] 2> 2545985 T5240 C1195 P53573 oasc.SolrCore.execute [awholynewcollection_0_shard5_replica4] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2546014 T5176 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2546015 T5176 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2546038 T5176 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2546040 T5176 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2546042 T5176 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2546042 T5176 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2546043 T5176 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2546044 T5176 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2546045 T5176 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2546069 T5176 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2546076 T5176 oass.SolrIndexSearcher.<init> Opening Searcher@5be8b9a1 main
[junit4] 2> 2546078 T5176 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2546079 T5176 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2546088 T5189 oasc.ZkController.register We are http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard3_replica3/ and leader is http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard3_replica1/
[junit4] 2> 2546089 T5189 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard3_replica3 baseURL=http://127.0.0.1:53576/dx_sd
[junit4] 2> 2546090 T5189 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard3_replica3
[junit4] 2> 2546090 T5189 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2546096 T5281 C1185 P53576 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard3_replica3 recoveringAfterStartup=true
[junit4] 2> 2546097 T5281 C1185 P53576 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2546104 T5280 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard4_replica4] Registered new searcher Searcher@5be8b9a1 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 2546105 T5281 C1185 P53576 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica3 state=recovering
[junit4] 2> 2546107 T5189 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2546111 T5281 C1185 P53576 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2546130 T5176 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard4_replica4
[junit4] 2> 2546131 T5176 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard4_replica4 address:http://127.0.0.1:53573/dx_sd collection:awholynewcollection_0 shard:shard4
[junit4] 2> 2546132 T5176 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 2546138 T5189 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard3&name=awholynewcollection_0_shard3_replica3&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=32798
[junit4] 2> 2546142 T5145 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node12, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2546304 T5130 oasc.ZkController.register We are http://127.0.0.1:53563/dx_sd/awholynewcollection_0_shard3_replica5/ and leader is http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard3_replica1/
[junit4] 2> 2546305 T5130 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard3_replica5 baseURL=http://127.0.0.1:53563/dx_sd
[junit4] 2> 2546306 T5130 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard3_replica5
[junit4] 2> 2546307 T5130 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2546310 T5282 C1187 P53563 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard3_replica5 recoveringAfterStartup=true
[junit4] 2> 2546311 T5282 C1187 P53563 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2546312 T5177 oasc.ZkController.register We are http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard3_replica4/ and leader is http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard3_replica1/
[junit4] 2> 2546313 T5177 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard3_replica4 baseURL=http://127.0.0.1:53573/dx_sd
[junit4] 2> 2546314 T5177 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard3_replica4
[junit4] 2> 2546315 T5177 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2546312 T5130 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2546318 T5282 C1187 P53563 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica5 state=recovering
[junit4] 2> 2546318 T5283 C1184 P53573 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard3_replica4 recoveringAfterStartup=true
[junit4] 2> 2546319 T5283 C1184 P53573 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2546322 T5283 C1184 P53573 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica4 state=recovering
[junit4] 2> 2546325 T5130 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard3&name=awholynewcollection_0_shard3_replica5&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=32939
[junit4] 2> 2546327 T5282 C1187 P53563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2546341 T5177 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2546345 T5283 C1184 P53573 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2546358 T5177 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard3&name=awholynewcollection_0_shard3_replica4&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=32995
[junit4] 2> 2546373 T5238 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node15, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2546377 T5147 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node14, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2546412 T5164 oasc.ZkController.register We are http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard3_replica2/ and leader is http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard3_replica1/
[junit4] 2> 2546413 T5164 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard3_replica2 baseURL=http://127.0.0.1:53570/dx_sd
[junit4] 2> 2546414 T5164 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard3_replica2
[junit4] 2> 2546414 T5164 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2546416 T5284 C1186 P53570 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard3_replica2 recoveringAfterStartup=true
[junit4] 2> 2546417 T5284 C1186 P53570 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2546420 T5284 C1186 P53570 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica2 state=recovering
[junit4] 2> 2546421 T5164 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2546449 T5284 C1186 P53570 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2546457 T5164 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard3&name=awholynewcollection_0_shard3_replica2&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=33122
[junit4] 2> 2546477 T5285 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node10, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2546510 T5163 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2546510 T5146 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2546511 T5146 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 2546512 T5146 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard4_replica1/
[junit4] 2> 2546510 T5163 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 2546513 T5163 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard2_replica2/
[junit4] 2> 2546513 T5146 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard4_replica1 url=http://127.0.0.1:53567/dx_sd START replicas=[http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard4_replica2/, http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard4_replica3/, http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard4_replica4/, http://127.0.0.1:53563/dx_sd/awholynewcollection_0_shard4_replica5/] nUpdates=100
[junit4] 2> 2546514 T5163 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard2_replica2 url=http://127.0.0.1:53570/dx_sd START replicas=[http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard2_replica1/, http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard2_replica3/, http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard2_replica4/, http://127.0.0.1:53563/dx_sd/awholynewcollection_0_shard2_replica5/] nUpdates=100
[junit4] 2> 2546519 T5146 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard4_replica1 url=http://127.0.0.1:53567/dx_sd DONE. We have no versions. sync failed.
[junit4] 2> 2546542 T5146 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2546542 T5146 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2546543 T5146 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard4_replica1/ shard4
[junit4] 2> 2546543 T5146 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leaders/shard4
[junit4] 2> ASYNC NEW_CORE C1196 name=awholynewcollection_0_shard4_replica5 org.apache.solr.core.SolrCore@5b64229 url=http://127.0.0.1:53563/dx_sd/awholynewcollection_0_shard4_replica5 node=127.0.0.1:53563_dx_sd C1196_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard4_replica5 props:{state=down, core=awholynewcollection_0_shard4_replica5, node_name=127.0.0.1:53563_dx_sd, base_url=http://127.0.0.1:53563/dx_sd}
[junit4] 2> 2546538 T5130 C1196 P53563 oasc.SolrCore.execute [awholynewcollection_0_shard4_replica5] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4] 2> 2546528 T5163 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard2_replica2 url=http://127.0.0.1:53570/dx_sd DONE. We have no versions. sync failed.
[junit4] 2> 2546544 T5163 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2546545 T5163 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2546545 T5163 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard2_replica2/ shard2
[junit4] 2> 2546546 T5163 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leaders/shard2
[junit4] 2> ASYNC NEW_CORE C1197 name=awholynewcollection_0_shard2_replica5 org.apache.solr.core.SolrCore@1edc8b49 url=http://127.0.0.1:53563/dx_sd/awholynewcollection_0_shard2_replica5 node=127.0.0.1:53563_dx_sd C1197_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard2_replica5 props:{state=down, core=awholynewcollection_0_shard2_replica5, node_name=127.0.0.1:53563_dx_sd, base_url=http://127.0.0.1:53563/dx_sd}
[junit4] 2> 2546568 T5130 C1197 P53563 oasc.SolrCore.execute [awholynewcollection_0_shard2_replica5] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> ASYNC NEW_CORE C1198 name=awholynewcollection_0_shard4_replica3 org.apache.solr.core.SolrCore@523be601 url=http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard4_replica3 node=127.0.0.1:53576_dx_sd C1198_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard4_replica3 props:{state=down, core=awholynewcollection_0_shard4_replica3, node_name=127.0.0.1:53576_dx_sd, base_url=http://127.0.0.1:53576/dx_sd}
[junit4] 2> 2546582 T5189 C1198 P53576 oasc.SolrCore.execute [awholynewcollection_0_shard4_replica3] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> ASYNC NEW_CORE C1199 name=awholynewcollection_0_shard2_replica3 org.apache.solr.core.SolrCore@7beac168 url=http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard2_replica3 node=127.0.0.1:53576_dx_sd C1199_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard2_replica3 props:{state=down, core=awholynewcollection_0_shard2_replica3, node_name=127.0.0.1:53576_dx_sd, base_url=http://127.0.0.1:53576/dx_sd}
[junit4] 2> 2546610 T5191 C1199 P53576 oasc.SolrCore.execute [awholynewcollection_0_shard2_replica3] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> ASYNC NEW_CORE C1200 name=awholynewcollection_0_shard2_replica1 org.apache.solr.core.SolrCore@4c9dcc39 url=http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard2_replica1 node=127.0.0.1:53567_dx_sd C1200_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard2_replica1 props:{state=down, core=awholynewcollection_0_shard2_replica1, node_name=127.0.0.1:53567_dx_sd, base_url=http://127.0.0.1:53567/dx_sd}
[junit4] 2> 2546611 T5292 C1200 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard2_replica1] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=8
[junit4] 2> ASYNC NEW_CORE C1201 name=awholynewcollection_0_shard4_replica4 org.apache.solr.core.SolrCore@432b8313 url=http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard4_replica4 node=127.0.0.1:53573_dx_sd C1201_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard4_replica4 props:{state=down, core=awholynewcollection_0_shard4_replica4, node_name=127.0.0.1:53573_dx_sd, base_url=http://127.0.0.1:53573/dx_sd}
[junit4] 2> 2546620 T5177 C1201 P53573 oasc.SolrCore.execute [awholynewcollection_0_shard4_replica4] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=3
[junit4] 2> ASYNC NEW_CORE C1202 name=awholynewcollection_0_shard4_replica2 org.apache.solr.core.SolrCore@4f9161fa url=http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard4_replica2 node=127.0.0.1:53570_dx_sd C1202_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard4_replica2 props:{state=down, core=awholynewcollection_0_shard4_replica2, node_name=127.0.0.1:53570_dx_sd, base_url=http://127.0.0.1:53570/dx_sd}
[junit4] 2> 2546623 T5162 C1202 P53570 oasc.SolrCore.execute [awholynewcollection_0_shard4_replica2] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> ASYNC NEW_CORE C1203 name=awholynewcollection_0_shard2_replica4 org.apache.solr.core.SolrCore@4faf5dfb url=http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard2_replica4 node=127.0.0.1:53573_dx_sd C1203_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard2_replica4 props:{state=down, core=awholynewcollection_0_shard2_replica4, node_name=127.0.0.1:53573_dx_sd, base_url=http://127.0.0.1:53573/dx_sd}
[junit4] 2> 2546624 T5240 C1203 P53573 oasc.SolrCore.execute [awholynewcollection_0_shard2_replica4] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2547413 T5137 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2547418 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node11",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2547476 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node12",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2547492 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node15",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53563_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53563/dx_sd"}
[junit4] 2> 2547506 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node14",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2547525 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node10",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2547572 T5154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2547573 T5136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2547574 T5182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2547575 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2547585 T5141 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2547589 T5168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2547589 T5213 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2547590 T5211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2547597 T5187 oasc.ZkController.register We are http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard2_replica3/ and leader is http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard2_replica2/
[junit4] 2> 2547598 T5187 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard2_replica3 baseURL=http://127.0.0.1:53576/dx_sd
[junit4] 2> 2547599 T5187 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard2_replica3
[junit4] 2> 2547600 T5187 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2547603 T5149 oasc.ZkController.register We are http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard2_replica1/ and leader is http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard2_replica2/
[junit4] 2> 2547604 T5149 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard2_replica1 baseURL=http://127.0.0.1:53567/dx_sd
[junit4] 2> 2547606 T5149 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard2_replica1
[junit4] 2> 2547606 T5149 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2547628 T5188 oasc.ZkController.register We are http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard5_replica3/ and leader is http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1/
[junit4] 2> 2547629 T5188 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard5_replica3 baseURL=http://127.0.0.1:53576/dx_sd
[junit4] 2> 2547632 T5188 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard5_replica3
[junit4] 2> 2547633 T5188 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2547637 T5192 oasc.ZkController.register We are http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard1_replica3/ and leader is http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard1_replica3/
[junit4] 2> 2547639 T5192 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard1_replica3 baseURL=http://127.0.0.1:53576/dx_sd
[junit4] 2> 2547640 T5295 C1199 P53576 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard2_replica3 recoveringAfterStartup=true
[junit4] 2> 2547637 T5150 oasc.ZkController.register We are http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1/ and leader is http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1/
[junit4] 2> 2547641 T5150 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard5_replica1 baseURL=http://127.0.0.1:53567/dx_sd
[junit4] 2> 2547642 T5150 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2547643 T5150 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica1 state=active
[junit4] 2> 2547637 T5148 oasc.ZkController.register We are http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard1_replica1/ and leader is http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard1_replica3/
[junit4] 2> 2547654 T5148 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard1_replica1 baseURL=http://127.0.0.1:53567/dx_sd
[junit4] 2> 2547654 T5148 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard1_replica1
[junit4] 2> 2547655 T5148 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2547637 T5176 oasc.ZkController.register We are http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard4_replica4/ and leader is http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard4_replica1/
[junit4] 2> 2547658 T5176 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard4_replica4 baseURL=http://127.0.0.1:53573/dx_sd
[junit4] 2> 2547658 T5176 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard4_replica4
[junit4] 2> 2547659 T5176 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2547654 T5296 C1192 P53576 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard5_replica3 recoveringAfterStartup=true
[junit4] 2> 2547668 T5149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2547672 T5298 C1188 P53567 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard1_replica1 recoveringAfterStartup=true
[junit4] 2> 2547651 T5297 C1200 P53567 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard2_replica1 recoveringAfterStartup=true
[junit4] 2> 2547673 T5297 C1200 P53567 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2547675 T5296 C1192 P53576 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2547676 T5298 C1188 P53567 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2547677 T5297 C1200 P53567 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica1 state=recovering
[junit4] 2> 2547678 T5296 C1192 P53576 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica3 state=recovering
[junit4] 2> 2547680 T5298 C1188 P53567 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica1 state=recovering
[junit4] 2> 2547681 T5160 oasc.ZkController.register We are http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard1_replica2/ and leader is http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard1_replica3/
[junit4] 2> 2547682 T5160 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard1_replica2 baseURL=http://127.0.0.1:53570/dx_sd
[junit4] 2> 2547683 T5160 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard1_replica2
[junit4] 2> 2547684 T5160 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2547649 T5187 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2547687 T5159 oasc.ZkController.register We are http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard4_replica2/ and leader is http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard4_replica1/
[junit4] 2> 2547688 T5159 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard4_replica2 baseURL=http://127.0.0.1:53570/dx_sd
[junit4] 2> 2547689 T5159 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard4_replica2
[junit4] 2> 2547689 T5159 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2547648 T5295 C1199 P53576 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2547696 T5149 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard2&name=awholynewcollection_0_shard2_replica1&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=34413
[junit4] 2> 2547698 T5161 oasc.ZkController.register We are http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard5_replica2/ and leader is http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1/
[junit4] 2> 2547699 T5161 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard5_replica2 baseURL=http://127.0.0.1:53570/dx_sd
[junit4] 2> 2547700 T5161 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard5_replica2
[junit4] 2> 2547700 T5161 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2547702 T5163 oasc.ZkController.register We are http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard2_replica2/ and leader is http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard2_replica2/
[junit4] 2> 2547702 T5163 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard2_replica2 baseURL=http://127.0.0.1:53570/dx_sd
[junit4] 2> 2547703 T5163 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2547704 T5163 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica2 state=active
[junit4] 2> 2547643 T5190 oasc.ZkController.register We are http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard4_replica3/ and leader is http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard4_replica1/
[junit4] 2> 2547706 T5190 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard4_replica3 baseURL=http://127.0.0.1:53576/dx_sd
[junit4] 2> 2547707 T5190 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard4_replica3
[junit4] 2> 2547708 T5190 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2547643 T5146 oasc.ZkController.register We are http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard4_replica1/ and leader is http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard4_replica1/
[junit4] 2> 2547711 T5146 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard4_replica1 baseURL=http://127.0.0.1:53567/dx_sd
[junit4] 2> 2547711 T5146 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2547712 T5146 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica1 state=active
[junit4] 2> 2547643 T5175 oasc.ZkController.register We are http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard5_replica4/ and leader is http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1/
[junit4] 2> 2547714 T5175 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard5_replica4 baseURL=http://127.0.0.1:53573/dx_sd
[junit4] 2> 2547715 T5175 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard5_replica4
[junit4] 2> 2547716 T5175 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2547719 T5300 C1193 P53570 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard5_replica2 recoveringAfterStartup=true
[junit4] 2> 2547643 T5174 oasc.ZkController.register We are http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard2_replica4/ and leader is http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard2_replica2/
[junit4] 2> 2547726 T5174 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard2_replica4 baseURL=http://127.0.0.1:53573/dx_sd
[junit4] 2> 2547727 T5174 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard2_replica4
[junit4] 2> 2547729 T5174 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2547643 T5173 oasc.ZkController.register We are http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard1_replica4/ and leader is http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard1_replica3/
[junit4] 2> 2547736 T5173 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard1_replica4 baseURL=http://127.0.0.1:53573/dx_sd
[junit4] 2> 2547736 T5173 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard1_replica4
[junit4] 2> 2547737 T5173 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2547738 T5297 C1200 P53567 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2547640 T5192 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2547739 T5192 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica3 state=active
[junit4] 2> 2547738 T5187 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard2&name=awholynewcollection_0_shard2_replica3&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=34439
[junit4] 2> 2547737 T5301 C1195 P53573 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard5_replica4 recoveringAfterStartup=true
[junit4] 2> 2547737 T5150 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2547725 T5299 C1189 P53570 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard1_replica2 recoveringAfterStartup=true
[junit4] 2> 2547750 T5298 C1188 P53567 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2547751 T5150 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard5&name=awholynewcollection_0_shard5_replica1&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=34312
[junit4] 2> 2547753 T5192 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2547755 T5160 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2547758 T5296 C1192 P53576 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2547791 T5302 C1201 P53573 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard4_replica4 recoveringAfterStartup=true
[junit4] 2> 2547792 T5302 C1201 P53573 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2547808 T5303 C1198 P53576 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard4_replica3 recoveringAfterStartup=true
[junit4] 2> 2547809 T5304 C1202 P53570 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard4_replica2 recoveringAfterStartup=true
[junit4] 2> 2547809 T5295 C1199 P53576 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica3 state=recovering
[junit4] 2> 2547810 T5301 C1195 P53573 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2547811 T5302 C1201 P53573 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica4 state=recovering
[junit4] 2> 2547811 T5299 C1189 P53570 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2547811 T5300 C1193 P53570 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2547813 T5305 C1203 P53573 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard2_replica4 recoveringAfterStartup=true
[junit4] 2> 2547833 T5302 C1201 P53573 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2547835 T5146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2547833 T5162 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2547825 T5306 C1190 P53573 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard1_replica4 recoveringAfterStartup=true
[junit4] 2> 2547847 T5192 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard1&name=awholynewcollection_0_shard1_replica3&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=34583
[junit4] 2> 2547848 T5159 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2547825 T5300 C1193 P53570 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica2 state=recovering
[junit4] 2> 2547824 T5299 C1189 P53570 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica2 state=recovering
[junit4] 2> 2547824 T5303 C1198 P53576 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2547852 T5303 C1198 P53576 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica3 state=recovering
[junit4] 2> 2547824 T5301 C1195 P53573 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica4 state=recovering
[junit4] 2> 2547824 T5304 C1202 P53570 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2547854 T5304 C1202 P53570 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica2 state=recovering
[junit4] 2> 2547854 T5146 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard4&name=awholynewcollection_0_shard4_replica1&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=34465
[junit4] 2> 2547821 T5175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2547868 T5295 C1199 P53576 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2547845 T5149 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node22, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2547834 T5160 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard1&name=awholynewcollection_0_shard1_replica2&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=34566
[junit4] 2> 2547874 T5188 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2547877 T5159 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard4&name=awholynewcollection_0_shard4_replica2&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=34477
[junit4] 2> 2547881 T5299 C1189 P53570 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2547899 T5303 C1198 P53576 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2547899 T5148 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2547901 T5301 C1195 P53573 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2547909 T5188 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard5&name=awholynewcollection_0_shard5_replica3&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=34458
[junit4] 2> 2547911 T5175 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard5&name=awholynewcollection_0_shard5_replica4&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=34450
[junit4] 2> 2547913 T5164 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node6, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2547924 T5300 C1193 P53570 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2547935 T5148 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard1&name=awholynewcollection_0_shard1_replica1&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=34665
[junit4] 2> 2547934 T5150 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node19, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2547989 T5173 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2547925 T5306 C1190 P53573 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2547991 T5191 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2547925 T5305 C1203 P53573 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2547925 T5163 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2547995 T5173 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard1&name=awholynewcollection_0_shard1_replica4&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=34724
[junit4] 2> 2547925 T5304 C1202 P53570 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2547993 T5305 C1203 P53573 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica4 state=recovering
[junit4] 2> 2548012 T5163 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard2&name=awholynewcollection_0_shard2_replica2&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=34717
[junit4] 2> 2548013 T5174 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2547989 T5146 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node18, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2547986 T5292 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node24, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2547986 T5190 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2548007 T5187 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2548000 T5306 C1190 P53573 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica4 state=recovering
[junit4] 2> 2548023 T5161 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2548024 T5305 C1203 P53573 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2548034 T5174 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard2&name=awholynewcollection_0_shard2_replica4&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=34723
[junit4] 2> 2548049 T5148 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node23, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2548053 T5306 C1190 P53573 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2548057 T5190 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard4&name=awholynewcollection_0_shard4_replica3&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=34650
[junit4] 2> 2548060 T5176 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2548057 T5160 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node8, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2548057 T5161 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard5&name=awholynewcollection_0_shard5_replica2&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=34609
[junit4] 2> 2548070 T5176 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard4&name=awholynewcollection_0_shard4_replica4&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=34655
[junit4] 2> 2548092 T5307 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node17, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2548101 T5192 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2548134 T5132 oasc.ZkController.register We are http://127.0.0.1:53563/dx_sd/awholynewcollection_0_shard5_replica5/ and leader is http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1/
[junit4] 2> 2548134 T5131 oasc.ZkController.register We are http://127.0.0.1:53563/dx_sd/awholynewcollection_0_shard4_replica5/ and leader is http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard4_replica1/
[junit4] 2> 2548136 T5131 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard4_replica5 baseURL=http://127.0.0.1:53563/dx_sd
[junit4] 2> 2548137 T5131 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard4_replica5
[junit4] 2> 2548138 T5131 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2548134 T5127 oasc.ZkController.register We are http://127.0.0.1:53563/dx_sd/awholynewcollection_0_shard1_replica5/ and leader is http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard1_replica3/
[junit4] 2> 2548139 T5308 C1196 P53563 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard4_replica5 recoveringAfterStartup=true
[junit4] 2> 2548137 T5128 oasc.ZkController.register We are http://127.0.0.1:53563/dx_sd/awholynewcollection_0_shard2_replica5/ and leader is http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard2_replica2/
[junit4] 2> 2548142 T5128 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard2_replica5 baseURL=http://127.0.0.1:53563/dx_sd
[junit4] 2> 2548135 T5132 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard5_replica5 baseURL=http://127.0.0.1:53563/dx_sd
[junit4] 2> 2548144 T5132 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard5_replica5
[junit4] 2> 2548145 T5132 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2548146 T5145 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node12, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 2548147 T5309 C1194 P53563 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard5_replica5 recoveringAfterStartup=true
[junit4] 2> 2548143 T5128 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard2_replica5
[junit4] 2> 2548150 T5128 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2548142 T5131 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2548141 T5308 C1196 P53563 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2548139 T5127 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard1_replica5 baseURL=http://127.0.0.1:53563/dx_sd
[junit4] 2> 2548179 T5127 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard1_replica5
[junit4] 2> 2548180 T5127 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 2548179 T5308 C1196 P53563 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica5 state=recovering
[junit4] 2> 2548182 T5311 C1191 P53563 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard1_replica5 recoveringAfterStartup=true
[junit4] 2> 2548175 T5310 C1197 P53563 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard2_replica5 recoveringAfterStartup=true
[junit4] 2> 2548184 T5311 C1191 P53563 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2548149 T5309 C1194 P53563 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2548147 T5145 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node12&state=recovering&nodeName=127.0.0.1:53576_dx_sd&action=PREPRECOVERY&checkLive=true&core=awholynewcollection_0_shard3_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2005
[junit4] 2> 2548186 T5311 C1191 P53563 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica5 state=recovering
[junit4] 2> 2548193 T5309 C1194 P53563 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica5 state=recovering
[junit4] 2> 2548187 T5310 C1197 P53563 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 2548182 T5128 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2548199 T5309 C1194 P53563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2548181 T5131 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard4&name=awholynewcollection_0_shard4_replica5&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=34746
[junit4] 2> 2548198 T5311 C1191 P53563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2548197 T5310 C1197 P53563 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica5 state=recovering
[junit4] 2> 2548196 T5308 C1196 P53563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2548238 T5145 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node25, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2548249 T5312 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node20, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2548253 T5128 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard2&name=awholynewcollection_0_shard2_replica5&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=34929
[junit4] 2> 2548255 T5189 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node9, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2548261 T5132 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2548261 T5310 C1197 P53563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2548265 T5132 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard5&name=awholynewcollection_0_shard5_replica5&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=34790
[junit4] 2> 2548267 T5127 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2548284 T5127 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard1&name=awholynewcollection_0_shard1_replica5&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=35008
[junit4] 2> 2548289 T5159 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node13, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 2548290 T5138 oasc.OverseerCollectionProcessor.createCollection Finished create command on all shards for collection: awholynewcollection_0
[junit4] 2> 2548302 T5182 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work/qnr-0000000002 state: SyncConnected type NodeDataChanged
[junit4] 2> 2548319 T5138 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000002 complete, response:{success={null={responseHeader={status=0,QTime=32576},core=awholynewcollection_0_shard3_replica1},null={responseHeader={status=0,QTime=32798},core=awholynewcollection_0_shard3_replica3},null={responseHeader={status=0,QTime=32939},core=awholynewcollection_0_shard3_replica5},null={responseHeader={status=0,QTime=32995},core=awholynewcollection_0_shard3_replica4},null={responseHeader={status=0,QTime=33122},core=awholynewcollection_0_shard3_replica2},null={responseHeader={status=0,QTime=34413},core=awholynewcollection_0_shard2_replica1},null={responseHeader={status=0,QTime=34439},core=awholynewcollection_0_shard2_replica3},null={responseHeader={status=0,QTime=34312},core=awholynewcollection_0_shard5_replica1},null={responseHeader={status=0,QTime=34583},core=awholynewcollection_0_shard1_replica3},null={responseHeader={status=0,QTime=34465},core=awholynewcollection_0_shard4_replica1},null={responseHeader={status=0,QTime=34566},core=awholynewcollection_0_shard1_replica2},null={responseHeader={status=0,QTime=34477},core=awholynewcollection_0_shard4_replica2},null={responseHeader={status=0,QTime=34458},core=awholynewcollection_0_shard5_replica3},null={responseHeader={status=0,QTime=34450},core=awholynewcollection_0_shard5_replica4},null={responseHeader={status=0,QTime=34665},core=awholynewcollection_0_shard1_replica1},null={responseHeader={status=0,QTime=34724},core=awholynewcollection_0_shard1_replica4},null={responseHeader={status=0,QTime=34717},core=awholynewcollection_0_shard2_replica2},null={responseHeader={status=0,QTime=34723},core=awholynewcollection_0_shard2_replica4},null={responseHeader={status=0,QTime=34650},core=awholynewcollection_0_shard4_replica3},null={responseHeader={status=0,QTime=34609},core=awholynewcollection_0_shard5_replica2},null={responseHeader={status=0,QTime=34655},core=awholynewcollection_0_shard4_replica4},null={responseHeader={status=0,QTime=34746},core=awholynewcollection_0_shard4_replica5},null={responseHeader={status=0,QTime=34929},core=awholynewcollection_0_shard2_replica5},null={responseHeader={status=0,QTime=34790},core=awholynewcollection_0_shard5_replica5},null={responseHeader={status=0,QTime=35008},core=awholynewcollection_0_shard1_replica5}}}
[junit4] 2> 2548326 T5178 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={numShards=5&maxShardsPerNode=6&name=awholynewcollection_0&replicationFactor=5&action=CREATE&wt=javabin&version=2} status=0 QTime=35082
[junit4] 2> 2548330 T5138 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000004 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "numShards":"5",
[junit4] 2> "maxShardsPerNode":"6",
[junit4] 2> "createNodeSet":null,
[junit4] 2> "name":"awholynewcollection_0",
[junit4] 2> "replicationFactor":"5"}
[junit4] 2> 2548331 T5138 oasc.SolrException.log ERROR Collection createcollection of createcollection failed:org.apache.solr.common.SolrException: collection already exists: awholynewcollection_0
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.createCollection(OverseerCollectionProcessor.java:738)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.processMessage(OverseerCollectionProcessor.java:175)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:127)
[junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4] 2>
[junit4] 2> 2548355 T5196 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work/qnr-0000000004 state: SyncConnected type NodeDataChanged
[junit4] 2> 2548362 T5136 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2548363 T5138 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000004 complete, response:{Operation createcollection caused exception:=org.apache.solr.common.SolrException: collection already exists: awholynewcollection_0,exception={msg=collection already exists: awholynewcollection_0,rspCode=400}}
[junit4] 2> 2548365 T5239 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={numShards=5&maxShardsPerNode=6&name=awholynewcollection_0&replicationFactor=5&action=CREATE&wt=javabin&version=2} status=400 QTime=5117
[junit4] 2> 2548377 T5238 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node15, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 2548378 T5238 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node15&state=recovering&nodeName=127.0.0.1:53563_dx_sd&action=PREPRECOVERY&checkLive=true&core=awholynewcollection_0_shard3_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2005
[junit4] 2> 2548383 T5147 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node14, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 2548384 T5147 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node14&state=recovering&nodeName=127.0.0.1:53573_dx_sd&action=PREPRECOVERY&checkLive=true&core=awholynewcollection_0_shard3_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2007
[junit4] 2> 2548417 T5114 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 53563
[junit4] 2> 2548417 T5114 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=59385804
[junit4] 2> 2548480 T5285 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node10, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 2548481 T5285 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node10&state=recovering&nodeName=127.0.0.1:53570_dx_sd&action=PREPRECOVERY&checkLive=true&core=awholynewcollection_0_shard3_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2004
[junit4] 2> 2549616 T5137 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2549621 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node21",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2549647 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node5",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2549661 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node22",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2549671 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2549682 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node16",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2549693 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node7",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2549714 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2549730 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node19",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2549744 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node6",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2549757 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2549774 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node23",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2549797 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node17",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2549813 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node24",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2549829 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node18",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2549856 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node8",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2549871 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2549888 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node20",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53563_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53563/dx_sd"}
[junit4] 2> 2549903 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node9",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53563_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53563/dx_sd"}
[junit4] 2> 2549928 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node25",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53563_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53563/dx_sd"}
[junit4] 2> 2549943 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node13",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53563_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53563/dx_sd"}
[junit4] 2> 2549957 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node15",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:53563_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53563/dx_sd"}
[junit4] 2> 2549957 T5137 oasc.Overseer$ClusterStateUpdater.updateState shard=shard3 is already registered
[junit4] 2> 2549975 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2549976 T5154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2549976 T5136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2549977 T5182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2549977 T5168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2549992 T5150 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node19, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 2549995 T5150 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node19&state=recovering&nodeName=127.0.0.1:53573_dx_sd&action=PREPRECOVERY&checkLive=true&core=awholynewcollection_0_shard4_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2061
[junit4] 2> 2549996 T5191 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 2549998 T5191 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node2&state=recovering&nodeName=127.0.0.1:53567_dx_sd&action=PREPRECOVERY&checkLive=true&core=awholynewcollection_0_shard1_replica3&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2007
[junit4] 2> 2550017 T5146 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node18, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 2550019 T5146 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node18&state=recovering&nodeName=127.0.0.1:53576_dx_sd&action=PREPRECOVERY&checkLive=true&core=awholynewcollection_0_shard4_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2030
[junit4] 2> 2550019 T5292 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node24, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 2550020 T5292 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node24&state=recovering&nodeName=127.0.0.1:53573_dx_sd&action=PREPRECOVERY&checkLive=true&core=awholynewcollection_0_shard5_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2034
[junit4] 2> 2550024 T5187 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node4, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 2550025 T5187 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node4&state=recovering&nodeName=127.0.0.1:53570_dx_sd&action=PREPRECOVERY&checkLive=true&core=awholynewcollection_0_shard1_replica3&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2018
[junit4] 2> 2550052 T5148 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node23, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 2550054 T5148 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node23&state=recovering&nodeName=127.0.0.1:53570_dx_sd&action=PREPRECOVERY&checkLive=true&core=awholynewcollection_0_shard5_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2006
[junit4] 2> 2550065 T5160 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node8, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 2550065 T5160 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node8&state=recovering&nodeName=127.0.0.1:53573_dx_sd&action=PREPRECOVERY&checkLive=true&core=awholynewcollection_0_shard2_replica2&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2008
[junit4] 2> 2550095 T5307 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node17, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 2550096 T5307 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node17&state=recovering&nodeName=127.0.0.1:53570_dx_sd&action=PREPRECOVERY&checkLive=true&core=awholynewcollection_0_shard4_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2005
[junit4] 2> 2550105 T5192 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 2550110 T5192 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node3&state=recovering&nodeName=127.0.0.1:53573_dx_sd&action=PREPRECOVERY&checkLive=true&core=awholynewcollection_0_shard1_replica3&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2009
[junit4] 2> C1185_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard3_replica3 props:{state=recovering, core=awholynewcollection_0_shard3_replica3, node_name=127.0.0.1:53576_dx_sd, base_url=http://127.0.0.1:53576/dx_sd}
[junit4] 2> 2550194 T5281 C1185 P53576 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard3_replica1/ core=awholynewcollection_0_shard3_replica3 - recoveringAfterStartup=true
[junit4] 2> 2550194 T5281 C1185 P53576 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard3_replica3 url=http://127.0.0.1:53576/dx_sd START replicas=[http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard3_replica1/] nUpdates=100
[junit4] 2> 2550195 T5281 C1185 P53576 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2550195 T5281 C1185 P53576 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=awholynewcollection_0_shard3_replica3
[junit4] 2> 2550195 T5281 C1185 P53576 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=awholynewcollection_0_shard3_replica3
[junit4] 2> 2550196 T5281 C1185 P53576 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=awholynewcollection_0_shard3_replica3
[junit4] 2> 2550196 T5281 C1185 P53576 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2550196 T5281 C1185 P53576 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard3_replica1/. core=awholynewcollection_0_shard3_replica3
[junit4] 2> 2550196 T5281 C1185 P53576 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> ASYNC NEW_CORE C1204 name=awholynewcollection_0_shard3_replica1 org.apache.solr.core.SolrCore@1c8cbb71 url=http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard3_replica1 node=127.0.0.1:53567_dx_sd C1204_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard3_replica1 props:{state=active, core=awholynewcollection_0_shard3_replica1, node_name=127.0.0.1:53567_dx_sd, base_url=http://127.0.0.1:53567/dx_sd, leader=true}
[junit4] 2> 2550207 T5146 C1204 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard3_replica1] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2550218 T5285 C1204 P53567 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2550221 T5285 C1204 P53567 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7743ab7c lockFactory=org.apache.lucene.store.NativeFSLockFactory@7f559085),segFN=segments_1,generation=1}
[junit4] 2> 2550221 T5285 C1204 P53567 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2550222 T5285 C1204 P53567 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2550223 T5285 C1204 P53567 oass.SolrIndexSearcher.<init> Opening Searcher@3cdbc741 realtime
[junit4] 2> 2550223 T5285 C1204 P53567 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2550223 T5285 C1204 P53567 oasup.LogUpdateProcessor.finish [awholynewcollection_0_shard3_replica1] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4] 2> 2550225 T5281 C1185 P53576 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2550225 T5281 C1185 P53576 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2550232 T5148 C1204 P53567 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2550239 T5148 C1204 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard3_replica1] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=11
[junit4] 2> 2550240 T5281 C1185 P53576 oasc.RecoveryStrategy.replay No replay needed. core=awholynewcollection_0_shard3_replica3
[junit4] 2> 2550240 T5281 C1185 P53576 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=awholynewcollection_0_shard3_replica3
[junit4] 2> 2550240 T5281 C1185 P53576 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica3 state=active
[junit4] 2> 2550242 T5281 C1185 P53576 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=awholynewcollection_0_shard3_replica3
[junit4] 2> 2550249 T5145 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node25, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 2550250 T5145 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node25&state=recovering&nodeName=127.0.0.1:53563_dx_sd&action=PREPRECOVERY&checkLive=true&core=awholynewcollection_0_shard5_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2012
[junit4] 2> 2550252 T5312 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node20, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 2550253 T5312 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node20&state=recovering&nodeName=127.0.0.1:53563_dx_sd&action=PREPRECOVERY&checkLive=true&core=awholynewcollection_0_shard4_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2004
[junit4] 2> 2550262 T5189 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node9, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 2550263 T5189 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node9&state=recovering&nodeName=127.0.0.1:53563_dx_sd&action=PREPRECOVERY&checkLive=true&core=awholynewcollection_0_shard1_replica3&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2008
[junit4] 2> 2550292 T5159 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node13, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 2550293 T5159 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node13&state=recovering&nodeName=127.0.0.1:53563_dx_sd&action=PREPRECOVERY&checkLive=true&core=awholynewcollection_0_shard2_replica2&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2004
[junit4] 2> 2550383 T5282 C1187 P53563 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard3_replica1/ core=awholynewcollection_0_shard3_replica5 - recoveringAfterStartup=true
[junit4] 2> 2550384 T5282 C1187 P53563 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard3_replica5 url=http://127.0.0.1:53563/dx_sd START replicas=[http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard3_replica1/] nUpdates=100
[junit4] 2> 2550385 T5282 C1187 P53563 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2550386 T5282 C1187 P53563 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=awholynewcollection_0_shard3_replica5
[junit4] 2> 2550387 T5282 C1187 P53563 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=awholynewcollection_0_shard3_replica5
[junit4] 2> 2550387 T5282 C1187 P53563 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=awholynewcollection_0_shard3_replica5
[junit4] 2> 2550388 T5282 C1187 P53563 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2550388 T5282 C1187 P53563 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard3_replica1/. core=awholynewcollection_0_shard3_replica5
[junit4] 2> 2550389 T5282 C1187 P53563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> C1184_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard3_replica4 props:{state=recovering, core=awholynewcollection_0_shard3_replica4, node_name=127.0.0.1:53573_dx_sd, base_url=http://127.0.0.1:53573/dx_sd}
[junit4] 2> 2550387 T5283 C1184 P53573 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard3_replica1/ core=awholynewcollection_0_shard3_replica4 - recoveringAfterStartup=true
[junit4] 2> 2550394 T5283 C1184 P53573 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard3_replica4 url=http://127.0.0.1:53573/dx_sd START replicas=[http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard3_replica1/] nUpdates=100
[junit4] 2> 2550397 T5283 C1184 P53573 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2550398 T5283 C1184 P53573 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=awholynewcollection_0_shard3_replica4
[junit4] 2> 2550398 T5283 C1184 P53573 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=awholynewcollection_0_shard3_replica4
[junit4] 2> 2550399 T5283 C1184 P53573 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=awholynewcollection_0_shard3_replica4
[junit4] 2> 2550399 T5283 C1184 P53573 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2550399 T5283 C1184 P53573 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard3_replica1/. core=awholynewcollection_0_shard3_replica4
[junit4] 2> 2550400 T5283 C1184 P53573 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2550407 T5150 C1204 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard3_replica1] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4] 2> 2550416 T5238 C1204 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard3_replica1] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4] 2> 2550432 T5146 C1204 P53567 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2550433 T5146 C1204 P53567 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2550434 T5146 C1204 P53567 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2550435 T5146 C1204 P53567 oasup.LogUpdateProcessor.finish [awholynewcollection_0_shard3_replica1] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 3
[junit4] 2> 2550445 T5282 C1187 P53563 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2550447 T5282 C1187 P53563 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2550448 T5292 C1204 P53567 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2550448 T5292 C1204 P53567 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2550449 T5292 C1204 P53567 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2550449 T5292 C1204 P53567 oasup.LogUpdateProcessor.finish [awholynewcollection_0_shard3_replica1] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 2
[junit4] 2> 2550451 T5283 C1184 P53573 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2550452 T5283 C1184 P53573 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2550453 T5145 C1204 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard3_replica1] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2550458 T5147 C1204 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard3_replica1] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2550460 T5282 C1187 P53563 oasc.RecoveryStrategy.replay No replay needed. core=awholynewcollection_0_shard3_replica5
[junit4] 2> 2550460 T5282 C1187 P53563 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=awholynewcollection_0_shard3_replica5
[junit4] 2> 2550461 T5282 C1187 P53563 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica5 state=active
[junit4] 2> 2550461 T5283 C1184 P53573 oasc.RecoveryStrategy.replay No replay needed. core=awholynewcollection_0_shard3_replica4
[junit4] 2> 2550462 T5283 C1184 P53573 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=awholynewcollection_0_shard3_replica4
[junit4] 2> 2550462 T5283 C1184 P53573 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica4 state=active
[junit4] 2> 2550463 T5282 C1187 P53563 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=awholynewcollection_0_shard3_replica5
[junit4] 2> 2550465 T5283 C1184 P53573 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=awholynewcollection_0_shard3_replica4
[junit4] 2> C1186_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard3_replica2 props:{state=recovering, core=awholynewcollection_0_shard3_replica2, node_name=127.0.0.1:53570_dx_sd, base_url=http://127.0.0.1:53570/dx_sd}
[junit4] 2> 2550484 T5284 C1186 P53570 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard3_replica1/ core=awholynewcollection_0_shard3_replica2 - recoveringAfterStartup=true
[junit4] 2> 2550487 T5284 C1186 P53570 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard3_replica2 url=http://127.0.0.1:53570/dx_sd START replicas=[http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard3_replica1/] nUpdates=100
[junit4] 2> 2550489 T5284 C1186 P53570 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2550489 T5284 C1186 P53570 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=awholynewcollection_0_shard3_replica2
[junit4] 2> 2550489 T5284 C1186 P53570 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=awholynewcollection_0_shard3_replica2
[junit4] 2> 2550490 T5284 C1186 P53570 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=awholynewcollection_0_shard3_replica2
[junit4] 2> 2550490 T5284 C1186 P53570 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2550490 T5284 C1186 P53570 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard3_replica1/. core=awholynewcollection_0_shard3_replica2
[junit4] 2> 2550491 T5284 C1186 P53570 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2550499 T5312 C1204 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard3_replica1] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2550526 T5150 C1204 P53567 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2550528 T5150 C1204 P53567 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2550529 T5150 C1204 P53567 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2550529 T5150 C1204 P53567 oasup.LogUpdateProcessor.finish [awholynewcollection_0_shard3_replica1] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 3
[junit4] 2> 2550532 T5284 C1186 P53570 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2550533 T5284 C1186 P53570 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2550536 T5146 C1204 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard3_replica1] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2550538 T5284 C1186 P53570 oasc.RecoveryStrategy.replay No replay needed. core=awholynewcollection_0_shard3_replica2
[junit4] 2> 2550539 T5284 C1186 P53570 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=awholynewcollection_0_shard3_replica2
[junit4] 2> 2550539 T5284 C1186 P53570 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica2 state=active
[junit4] 2> 2550542 T5284 C1186 P53570 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=awholynewcollection_0_shard3_replica2
[junit4] 2> 2550855 T5162 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node5, state: recovering, checkLive: true, onlyIfLeader: true for: 3 seconds.
[junit4] 2> 2550856 T5162 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node5&state=recovering&nodeName=127.0.0.1:53567_dx_sd&action=PREPRECOVERY&checkLive=true&core=awholynewcollection_0_shard2_replica2&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=3023
[junit4] 2> 2550875 T5149 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node22, state: recovering, checkLive: true, onlyIfLeader: true for: 3 seconds.
[junit4] 2> 2550876 T5149 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node22&state=recovering&nodeName=127.0.0.1:53576_dx_sd&action=PREPRECOVERY&checkLive=true&core=awholynewcollection_0_shard5_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=3031
[junit4] 2> 2550921 T5164 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node6, state: recovering, checkLive: true, onlyIfLeader: true for: 3 seconds.
[junit4] 2> 2550922 T5164 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node6&state=recovering&nodeName=127.0.0.1:53576_dx_sd&action=PREPRECOVERY&checkLive=true&core=awholynewcollection_0_shard2_replica2&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=3009
[junit4] 2> 2551426 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica5 state=down
[junit4] 2> 2551431 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica5 state=down
[junit4] 2> 2551433 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica5 state=down
[junit4] 2> 2551435 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica5 state=down
[junit4] 2> 2551438 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica5 state=down
[junit4] 2> 2551440 T5114 oasc.RecoveryStrategy.close WARN Stopping recovery for zkNodeName=core_node20core=awholynewcollection_0_shard4_replica5
[junit4] 2> 2551626 T5137 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2551629 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node12",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2551640 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node15",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53563_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53563/dx_sd"}
[junit4] 2> 2551651 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node14",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2551664 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node10",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2551677 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node20",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53563_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53563/dx_sd"}
[junit4] 2> 2551688 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node15",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53563_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53563/dx_sd"}
[junit4] 2> 2551707 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node13",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53563_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53563/dx_sd"}
[junit4] 2> 2551717 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node9",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53563_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53563/dx_sd"}
[junit4] 2> 2551729 T5137 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node25",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53563_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53563/dx_sd"}
[junit4] 2> 2551743 T5182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2551752 T5136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2551752 T5168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2551752 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2551753 T5154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> C1201_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard4_replica4 props:{state=recovering, core=awholynewcollection_0_shard4_replica4, node_name=127.0.0.1:53573_dx_sd, base_url=http://127.0.0.1:53573/dx_sd}
[junit4] 2> 2552003 T5302 C1201 P53573 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard4_replica1/ core=awholynewcollection_0_shard4_replica4 - recoveringAfterStartup=true
[junit4] 2> C1188_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard1_replica1 props:{state=recovering, core=awholynewcollection_0_shard1_replica1, node_name=127.0.0.1:53567_dx_sd, base_url=http://127.0.0.1:53567/dx_sd}
[junit4] 2> 2552003 T5298 C1188 P53567 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard1_replica3/ core=awholynewcollection_0_shard1_replica1 - recoveringAfterStartup=true
[junit4] 2> 2552004 T5302 C1201 P53573 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard4_replica4 url=http://127.0.0.1:53573/dx_sd START replicas=[http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard4_replica1/] nUpdates=100
[junit4] 2> 2552004 T5298 C1188 P53567 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard1_replica1 url=http://127.0.0.1:53567/dx_sd START replicas=[http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard1_replica3/] nUpdates=100
[junit4] 2> 2552005 T5302 C1201 P53573 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2552006 T5302 C1201 P53573 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=awholynewcollection_0_shard4_replica4
[junit4] 2> 2552006 T5302 C1201 P53573 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=awholynewcollection_0_shard4_replica4
[junit4] 2> 2552006 T5302 C1201 P53573 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=awholynewcollection_0_shard4_replica4
[junit4] 2> 2552006 T5302 C1201 P53573 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2552007 T5302 C1201 P53573 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard4_replica1/. core=awholynewcollection_0_shard4_replica4
[junit4] 2> 2552007 T5302 C1201 P53573 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2552007 T5298 C1188 P53567 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2552008 T5298 C1188 P53567 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=awholynewcollection_0_shard1_replica1
[junit4] 2> 2552009 T5298 C1188 P53567 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=awholynewcollection_0_shard1_replica1
[junit4] 2> 2552009 T5298 C1188 P53567 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=awholynewcollection_0_shard1_replica1
[junit4] 2> 2552010 T5298 C1188 P53567 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2552010 T5298 C1188 P53567 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard1_replica3/. core=awholynewcollection_0_shard1_replica1
[junit4] 2> 2552010 T5298 C1188 P53567 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> C1198_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard4_replica3 props:{state=recovering, core=awholynewcollection_0_shard4_replica3, node_name=127.0.0.1:53576_dx_sd, base_url=http://127.0.0.1:53576/dx_sd}
[junit4] 2> 2552022 T5303 C1198 P53576 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard4_replica1/ core=awholynewcollection_0_shard4_replica3 - recoveringAfterStartup=true
[junit4] 2> 2552023 T5303 C1198 P53576 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard4_replica3 url=http://127.0.0.1:53576/dx_sd START replicas=[http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard4_replica1/] nUpdates=100
[junit4] 2> C1195_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard5_replica4 props:{state=recovering, core=awholynewcollection_0_shard5_replica4, node_name=127.0.0.1:53573_dx_sd, base_url=http://127.0.0.1:53573/dx_sd}
[junit4] 2> 2552025 T5301 C1195 P53573 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1/ core=awholynewcollection_0_shard5_replica4 - recoveringAfterStartup=true
[junit4] 2> 2552025 T5301 C1195 P53573 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard5_replica4 url=http://127.0.0.1:53573/dx_sd START replicas=[http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1/] nUpdates=100
[junit4] 2> C1189_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard1_replica2 props:{state=recovering, core=awholynewcollection_0_shard1_replica2, node_name=127.0.0.1:53570_dx_sd, base_url=http://127.0.0.1:53570/dx_sd}
[junit4] 2> 2552037 T5299 C1189 P53570 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard1_replica3/ core=awholynewcollection_0_shard1_replica2 - recoveringAfterStartup=true
[junit4] 2> 2552037 T5303 C1198 P53576 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2552038 T5303 C1198 P53576 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=awholynewcollection_0_shard4_replica3
[junit4] 2> 2552038 T5303 C1198 P53576 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=awholynewcollection_0_shard4_replica3
[junit4] 2> 2552039 T5303 C1198 P53576 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=awholynewcollection_0_shard4_replica3
[junit4] 2> 2552039 T5303 C1198 P53576 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2552039 T5303 C1198 P53576 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard4_replica1/. core=awholynewcollection_0_shard4_replica3
[junit4] 2> 2552040 T5303 C1198 P53576 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2552037 T5299 C1189 P53570 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard1_replica2 url=http://127.0.0.1:53570/dx_sd START replicas=[http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard1_replica3/] nUpdates=100
[junit4] 2> ASYNC NEW_CORE C1205 name=awholynewcollection_0_shard4_replica1 org.apache.solr.core.SolrCore@39067512 url=http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard4_replica1 node=127.0.0.1:53567_dx_sd C1205_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard4_replica1 props:{state=active, core=awholynewcollection_0_shard4_replica1, node_name=127.0.0.1:53567_dx_sd, base_url=http://127.0.0.1:53567/dx_sd, leader=true}
[junit4] 2> 2552070 T5147 C1205 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard4_replica1] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> C1203_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard2_replica4 props:{state=recovering, core=awholynewcollection_0_shard2_replica4, node_name=127.0.0.1:53573_dx_sd, base_url=http://127.0.0.1:53573/dx_sd}
[junit4] 2> 2552068 T5305 C1203 P53573 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard2_replica2/ core=awholynewcollection_0_shard2_replica4 - recoveringAfterStartup=true
[junit4] 2> 2552075 T5305 C1203 P53573 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard2_replica4 url=http://127.0.0.1:53573/dx_sd START replicas=[http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard2_replica2/] nUpdates=100
[junit4] 2> 2552042 T5301 C1195 P53573 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2552118 T5301 C1195 P53573 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=awholynewcollection_0_shard5_replica4
[junit4] 2> 2552118 T5301 C1195 P53573 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=awholynewcollection_0_shard5_replica4
[junit4] 2> 2552119 T5301 C1195 P53573 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=awholynewcollection_0_shard5_replica4
[junit4] 2> 2552119 T5301 C1195 P53573 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2552119 T5301 C1195 P53573 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1/. core=awholynewcollection_0_shard5_replica4
[junit4] 2> 2552120 T5301 C1195 P53573 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2552060 T5145 C1205 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard4_replica1] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=4
[junit4] 2> C1193_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard5_replica2 props:{state=recovering, core=awholynewcollection_0_shard5_replica2, node_name=127.0.0.1:53570_dx_sd, base_url=http://127.0.0.1:53570/dx_sd}
[junit4] 2> 2552056 T5300 C1193 P53570 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1/ core=awholynewcollection_0_shard5_replica2 - recoveringAfterStartup=true
[junit4] 2> 2552125 T5300 C1193 P53570 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard5_replica2 url=http://127.0.0.1:53570/dx_sd START replicas=[http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1/] nUpdates=100
[junit4] 2> 2552136 T5238 C1205 P53567 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2552138 T5300 C1193 P53570 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2552139 T5300 C1193 P53570 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=awholynewcollection_0_shard5_replica2
[junit4] 2> 2552139 T5300 C1193 P53570 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=awholynewcollection_0_shard5_replica2
[junit4] 2> 2552140 T5300 C1193 P53570 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=awholynewcollection_0_shard5_replica2
[junit4] 2> 2552141 T5300 C1193 P53570 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2552141 T5300 C1193 P53570 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1/. core=awholynewcollection_0_shard5_replica2
[junit4] 2> 2552141 T5300 C1193 P53570 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> ASYNC NEW_CORE C1206 name=awholynewcollection_0_shard2_replica2 org.apache.solr.core.SolrCore@5e053cfd url=http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard2_replica2 node=127.0.0.1:53570_dx_sd C1206_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard2_replica2 props:{state=active, core=awholynewcollection_0_shard2_replica2, node_name=127.0.0.1:53570_dx_sd, base_url=http://127.0.0.1:53570/dx_sd, leader=true}
[junit4] 2> 2552146 T5162 C1206 P53570 oasc.SolrCore.execute [awholynewcollection_0_shard2_replica2] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> ASYNC NEW_CORE C1207 name=awholynewcollection_0_shard5_replica1 org.apache.solr.core.SolrCore@38d0bf14 url=http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1 node=127.0.0.1:53567_dx_sd C1207_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard5_replica1 props:{state=active, core=awholynewcollection_0_shard5_replica1, node_name=127.0.0.1:53567_dx_sd, base_url=http://127.0.0.1:53567/dx_sd, leader=true}
[junit4] 2> 2552150 T5149 C1207 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard5_replica1] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> ASYNC NEW_CORE C1208 name=awholynewcollection_0_shard1_replica3 org.apache.solr.core.SolrCore@1550fd90 url=http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard1_replica3 node=127.0.0.1:53576_dx_sd C1208_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard1_replica3 props:{state=active, core=awholynewcollection_0_shard1_replica3, node_name=127.0.0.1:53576_dx_sd, base_url=http://127.0.0.1:53576/dx_sd, leader=true}
[junit4] 2> 2552050 T5192 C1208 P53576 oasc.SolrCore.execute [awholynewcollection_0_shard1_replica3] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4] 2> 2552118 T5305 C1203 P53573 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2552161 T5305 C1203 P53573 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=awholynewcollection_0_shard2_replica4
[junit4] 2> 2552162 T5305 C1203 P53573 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=awholynewcollection_0_shard2_replica4
[junit4] 2> 2552162 T5305 C1203 P53573 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=awholynewcollection_0_shard2_replica4
[junit4] 2> 2552162 T5305 C1203 P53573 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2552163 T5305 C1203 P53573 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard2_replica2/. core=awholynewcollection_0_shard2_replica4
[junit4] 2> 2552163 T5305 C1203 P53573 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2552118 T5189 C1208 P53576 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> C1190_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard1_replica4 props:{state=recovering, core=awholynewcollection_0_shard1_replica4, node_name=127.0.0.1:53573_dx_sd, base_url=http://127.0.0.1:53573/dx_sd}
[junit4] 2> 2552116 T5306 C1190 P53573 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard1_replica3/ core=awholynewcollection_0_shard1_replica4 - recoveringAfterStartup=true
[junit4] 2> 2552166 T5306 C1190 P53573 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard1_replica4 url=http://127.0.0.1:53573/dx_sd START replicas=[http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard1_replica3/] nUpdates=100
[junit4] 2> 2552167 T5306 C1190 P53573 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2552167 T5306 C1190 P53573 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=awholynewcollection_0_shard1_replica4
[junit4] 2> 2552168 T5306 C1190 P53573 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=awholynewcollection_0_shard1_replica4
[junit4] 2> 2552168 T5306 C1190 P53573 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=awholynewcollection_0_shard1_replica4
[junit4] 2> 2552168 T5306 C1190 P53573 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2552169 T5306 C1190 P53573 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard1_replica3/. core=awholynewcollection_0_shard1_replica4
[junit4] 2> 2552170 T5306 C1190 P53573 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2552104 T5312 C1207 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard5_replica1] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=3
[junit4] 2> C1202_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard4_replica2 props:{state=recovering, core=awholynewcollection_0_shard4_replica2, node_name=127.0.0.1:53570_dx_sd, base_url=http://127.0.0.1:53570/dx_sd}
[junit4] 2> 2552099 T5304 C1202 P53570 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard4_replica1/ core=awholynewcollection_0_shard4_replica2 - recoveringAfterStartup=true
[junit4] 2> 2552188 T5304 C1202 P53570 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard4_replica2 url=http://127.0.0.1:53570/dx_sd START replicas=[http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard4_replica1/] nUpdates=100
[junit4] 2> 2552081 T5188 C1208 P53576 oasc.SolrCore.execute [awholynewcollection_0_shard1_replica3] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4] 2> 2552076 T5299 C1189 P53570 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2552190 T5299 C1189 P53570 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=awholynewcollection_0_shard1_replica2
[junit4] 2> 2552190 T5299 C1189 P53570 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=awholynewcollection_0_shard1_replica2
[junit4] 2> 2552191 T5299 C1189 P53570 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=awholynewcollection_0_shard1_replica2
[junit4] 2> 2552191 T5299 C1189 P53570 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2552191 T5299 C1189 P53570 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard1_replica3/. core=awholynewcollection_0_shard1_replica2
[junit4] 2> 2552192 T5299 C1189 P53570 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2552190 T5304 C1202 P53570 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2552200 T5304 C1202 P53570 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=awholynewcollection_0_shard4_replica2
[junit4] 2> 2552200 T5304 C1202 P53570 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=awholynewcollection_0_shard4_replica2
[junit4] 2> 2552201 T5304 C1202 P53570 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=awholynewcollection_0_shard4_replica2
[junit4] 2> 2552201 T5304 C1202 P53570 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2552201 T5304 C1202 P53570 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard4_replica1/. core=awholynewcollection_0_shard4_replica2
[junit4] 2> 2552202 T5304 C1202 P53570 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2552203 T5285 C1205 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard4_replica1] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2552211 T5191 C1208 P53576 oasc.SolrCore.execute [awholynewcollection_0_shard1_replica3] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2552224 T5238 C1205 P53567 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a6b8a90 lockFactory=org.apache.lucene.store.NativeFSLockFactory@539a9171),segFN=segments_1,generation=1}
[junit4] 2> 2552242 T5292 C1207 P53567 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2552231 T5189 C1208 P53576 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@553d9432 lockFactory=org.apache.lucene.store.NativeFSLockFactory@10eab6ad),segFN=segments_1,generation=1}
[junit4] 2> 2552250 T5238 C1205 P53567 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2552252 T5309 C1194 P53563 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1/ core=awholynewcollection_0_shard5_replica5 - recoveringAfterStartup=true
[junit4] 2> 2552253 T5309 C1194 P53563 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard5_replica5 url=http://127.0.0.1:53563/dx_sd START replicas=[http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1/] nUpdates=100
[junit4] 2> 2552252 T5238 C1205 P53567 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2552268 T5238 C1205 P53567 oass.SolrIndexSearcher.<init> Opening Searcher@641c85a6 realtime
[junit4] 2> 2552271 T5238 C1205 P53567 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2552267 T5309 C1194 P53563 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2552273 T5309 C1194 P53563 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=awholynewcollection_0_shard5_replica5
[junit4] 2> 2552273 T5309 C1194 P53563 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=awholynewcollection_0_shard5_replica5
[junit4] 2> 2552273 T5309 C1194 P53563 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=awholynewcollection_0_shard5_replica5
[junit4] 2> 2552274 T5309 C1194 P53563 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2552274 T5309 C1194 P53563 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1/. core=awholynewcollection_0_shard5_replica5
[junit4] 2> 2552275 T5309 C1194 P53563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2552267 T5311 C1191 P53563 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard1_replica3/ core=awholynewcollection_0_shard1_replica5 - recoveringAfterStartup=true
[junit4] 2> 2552276 T5311 C1191 P53563 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard1_replica5 url=http://127.0.0.1:53563/dx_sd START replicas=[http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard1_replica3/] nUpdates=100
[junit4] 2> 2552277 T5311 C1191 P53563 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2552277 T5311 C1191 P53563 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=awholynewcollection_0_shard1_replica5
[junit4] 2> 2552278 T5311 C1191 P53563 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=awholynewcollection_0_shard1_replica5
[junit4] 2> 2552278 T5311 C1191 P53563 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=awholynewcollection_0_shard1_replica5
[junit4] 2> 2552279 T5311 C1191 P53563 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2552279 T5311 C1191 P53563 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard1_replica3/. core=awholynewcollection_0_shard1_replica5
[junit4] 2> 2552280 T5311 C1191 P53563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2552266 T5308 C1196 P53563 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard4_replica1/ core=awholynewcollection_0_shard4_replica5 - recoveringAfterStartup=true
[junit4] 2> 2552283 T5308 C1196 P53563 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard4_replica5 url=http://127.0.0.1:53563/dx_sd START replicas=[http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard4_replica1/] nUpdates=100
[junit4] 2> 2552284 T5308 C1196 P53563 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2552284 T5308 C1196 P53563 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=awholynewcollection_0_shard4_replica5
[junit4] 2> 2552284 T5308 C1196 P53563 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=awholynewcollection_0_shard4_replica5
[junit4] 2> 2552285 T5308 C1196 P53563 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=awholynewcollection_0_shard4_replica5
[junit4] 2> 2552285 T5308 C1196 P53563 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2552285 T5308 C1196 P53563 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard4_replica1/. core=awholynewcollection_0_shard4_replica5
[junit4] 2> 2552286 T5308 C1196 P53563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2552262 T5189 C1208 P53576 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2552274 T5147 C1207 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard5_replica1] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2552291 T5189 C1208 P53576 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2552292 T5189 C1208 P53576 oass.SolrIndexSearcher.<init> Opening Searcher@6a73bd57 realtime
[junit4] 2> 2552294 T5189 C1208 P53576 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2552294 T5239 C1208 P53576 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2552295 T5239 C1208 P53576 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2552296 T5310 C1197 P53563 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard2_replica2/ core=awholynewcollection_0_shard2_replica5 - recoveringAfterStartup=true
[junit4] 2> 2552297 T5310 C1197 P53563 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard2_replica5 url=http://127.0.0.1:53563/dx_sd START replicas=[http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard2_replica2/] nUpdates=100
[junit4] 2> 2552297 T5146 C1205 P53567 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2552298 T5310 C1197 P53563 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2552295 T5187 C1208 P53576 oasc.SolrCore.execute [awholynewcollection_0_shard1_replica3] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2552298 T5310 C1197 P53563 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=awholynewcollection_0_shard2_replica5
[junit4] 2> 2552300 T5310 C1197 P53563 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=awholynewcollection_0_shard2_replica5
[junit4] 2> 2552300 T5310 C1197 P53563 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=awholynewcollection_0_shard2_replica5
[junit4] 2> 2552301 T5310 C1197 P53563 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2552301 T5310 C1197 P53563 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard2_replica2/. core=awholynewcollection_0_shard2_replica5
[junit4] 2> 2552302 T5310 C1197 P53563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2552298 T5238 C1205 P53567 oasup.LogUpdateProcessor.finish [awholynewcollection_0_shard4_replica1] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 162
[junit4] 2> 2552298 T5146 C1205 P53567 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2552297 T5307 C1205 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard4_replica1] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2552311 T5189 C1208 P53576 oasup.LogUpdateProcessor.finish [awholynewcollection_0_shard1_replica3] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 194
[junit4] 2> 2552312 T5164 C1206 P53570 oasc.SolrCore.execute [awholynewcollection_0_shard2_replica2] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2552320 T5303 C1198 P53576 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2552321 T5303 C1198 P53576 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2552326 T5298 C1188 P53567 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2552339 T5149 C1205 P53567 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2552351 T5149 C1205 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard4_replica1] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=12
[junit4] 2> 2552329 T5146 C1205 P53567 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2552353 T5146 C1205 P53567 oasup.LogUpdateProcessor.finish [awholynewcollection_0_shard4_replica1] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 212
[junit4] 2> 2552329 T5239 C1208 P53576 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2552355 T5239 C1208 P53576 oasup.LogUpdateProcessor.finish [awholynewcollection_0_shard1_replica3] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 82
[junit4] 2> 2552353 T5148 C1205 P53567 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2552357 T5148 C1205 P53567 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2552348 T5163 C1206 P53570 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2552346 T5292 C1207 P53567 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5cb50451 lockFactory=org.apache.lucene.store.NativeFSLockFactory@704adfe2),segFN=segments_1,generation=1}
[junit4] 2> 2552381 T5163 C1206 P53570 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@188b45f2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@33968eda),segFN=segments_1,generation=1}
[junit4] 2> 2552382 T5163 C1206 P53570 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2552382 T5163 C1206 P53570 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2552383 T5163 C1206 P53570 oass.SolrIndexSearcher.<init> Opening Searcher@201a3bdb realtime
[junit4] 2> 2552383 T5163 C1206 P53570 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2552384 T5160 C1206 P53570 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2552385 T5160 C1206 P53570 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2552344 T5298 C1188 P53567 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2552384 T5163 C1206 P53570 oasup.LogUpdateProcessor.finish [awholynewcollection_0_shard2_replica2] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 37
[junit4] 2> 2552376 T5148 C1205 P53567 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2552391 T5148 C1205 P53567 oasup.LogUpdateProcessor.finish [awholynewcollection_0_shard4_replica1] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 144
[junit4] 2> 2552360 T5299 C1189 P53570 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2552395 T5299 C1189 P53570 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2552395 T5187 C1208 P53576 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2552396 T5187 C1208 P53576 oasc.SolrCore.execute [awholynewcollection_0_shard1_replica3] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 2552359 T5303 C1198 P53576 oasc.RecoveryStrategy.replay No replay needed. core=awholynewcollection_0_shard4_replica3
[junit4] 2> 2552358 T5302 C1201 P53573 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2552399 T5302 C1201 P53573 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2552355 T5188 C1208 P53576 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2552400 T5188 C1208 P53576 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2552401 T5188 C1208 P53576 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2552401 T5188 C1208 P53576 oasup.LogUpdateProcessor.finish [awholynewcollection_0_shard1_replica3] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 60
[junit4] 2> 2552402 T5191 C1208 P53576 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2552403 T5191 C1208 P53576 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2552404 T5191 C1208 P53576 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2552405 T5191 C1208 P53576 oasup.LogUpdateProcessor.finish [awholynewcollection_0_shard1_replica3] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 53
[junit4] 2> 2552399 T5303 C1198 P53576 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=awholynewcollection_0_shard4_replica3
[junit4] 2> 2552399 T5298 C1188 P53567 oasc.RecoveryStrategy.replay No replay needed. core=awholynewcollection_0_shard1_replica1
[junit4] 2> 2552407 T5298 C1188 P53567 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=awholynewcollection_0_shard1_replica1
[junit4] 2> 2552407 T5298 C1188 P53567 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica1 state=active
[junit4] 2> 2552398 T5189 C1208 P53576 oasc.SolrCore.execute [awholynewcollection_0_shard1_replica3] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2552395 T5160 C1206 P53570 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2552409 T5160 C1206 P53570 oasup.LogUpdateProcessor.finish [awholynewcollection_0_shard2_replica2] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 35
[junit4] 2> 2552409 T5299 C1189 P53570 oasc.RecoveryStrategy.replay No replay needed. core=awholynewcollection_0_shard1_replica2
[junit4] 2> 2552410 T5299 C1189 P53570 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=awholynewcollection_0_shard1_replica2
[junit4] 2> 2552411 T5299 C1189 P53570 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica2 state=active
[junit4] 2> 2552411 T5310 C1197 P53563 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2552394 T5304 C1202 P53570 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2552413 T5304 C1202 P53570 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2552413 T5310 C1197 P53563 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2552414 T5299 C1189 P53570 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=awholynewcollection_0_shard1_replica2
[junit4] 2> 2552393 T5305 C1203 P53573 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2552418 T5305 C1203 P53573 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2552391 T5285 C1205 P53567 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2552419 T5285 C1205 P53567 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2552390 T5292 C1207 P53567 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2552422 T5292 C1207 P53567 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2552423 T5292 C1207 P53567 oass.SolrIndexSearcher.<init> Opening Searcher@65483085 realtime
[junit4] 2> 2552423 T5292 C1207 P53567 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2552424 T5292 C1207 P53567 oasup.LogUpdateProcessor.finish [awholynewcollection_0_shard5_replica1] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 182
[junit4] 2> 2552418 T5159 C1206 P53570 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2552425 T5159 C1206 P53570 oasc.SolrCore.execute [awholynewcollection_0_shard2_replica2] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=8
[junit4] 2> 2552426 T5159 C1206 P53570 oasc.SolrCore.execute [awholynewcollection_0_shard2_replica2] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2552427 T5150 C1207 P53567 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2552428 T5150 C1207 P53567 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2552418 T5147 C1205 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard4_replica1] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2552411 T5298 C1188 P53567 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=awholynewcollection_0_shard1_replica1
[junit4] 2> 2552430 T5305 C1203 P53573 oasc.RecoveryStrategy.replay No replay needed. core=awholynewcollection_0_shard2_replica4
[junit4] 2> 2552431 T5305 C1203 P53573 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=awholynewcollection_0_shard2_replica4
[junit4] 2> 2552432 T5305 C1203 P53573 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica4 state=active
[junit4] 2> 2552410 T5311 C1191 P53563 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2552434 T5311 C1191 P53563 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2552435 T5305 C1203 P53573 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=awholynewcollection_0_shard2_replica4
[junit4] 2> 2552408 T5303 C1198 P53576 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica3 state=active
[junit4] 2> 2552403 T5306 C1190 P53573 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2552439 T5190 C1208 P53576 oasc.SolrCore.execute [awholynewcollection_0_shard1_replica3] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2552403 T5145 C1205 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard4_replica1] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2552440 T5311 C1191 P53563 oasc.RecoveryStrategy.replay No replay needed. core=awholynewcollection_0_shard1_replica5
[junit4] 2> 2552440 T5311 C1191 P53563 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=awholynewcollection_0_shard1_replica5
[junit4] 2> 2552441 T5311 C1191 P53563 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica5 state=active
[junit4] 2> 2552439 T5306 C1190 P53573 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2552432 T5304 C1202 P53570 oasc.RecoveryStrategy.replay No replay needed. core=awholynewcollection_0_shard4_replica2
[junit4] 2> 2552443 T5304 C1202 P53570 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=awholynewcollection_0_shard4_replica2
[junit4] 2> 2552443 T5304 C1202 P53570 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica2 state=active
[junit4] 2> 2552445 T5187 C1208 P53576 oasc.SolrCore.execute [awholynewcollection_0_shard1_replica3] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2552446 T5304 C1202 P53570 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=awholynewcollection_0_shard4_replica2
[junit4] 2> 2552432 T5310 C1197 P53563 oasc.RecoveryStrategy.replay No replay needed. core=awholynewcollection_0_shard2_replica5
[junit4] 2> 2552448 T5310 C1197 P53563 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=awholynewcollection_0_shard2_replica5
[junit4] 2> 2552448 T5310 C1197 P53563 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica5 state=active
[junit4] 2> 2552432 T5285 C1205 P53567 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2552449 T5285 C1205 P53567 oasup.LogUpdateProcessor.finish [awholynewcollection_0_shard4_replica1] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 88
[junit4] 2> 2552432 T5150 C1207 P53567 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2552451 T5150 C1207 P53567 oasup.LogUpdateProcessor.finish [awholynewcollection_0_shard5_replica1] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 114
[junit4] 2> 2552431 T5300 C1193 P53570 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2552453 T5300 C1193 P53570 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2552454 T5310 C1197 P53563 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=awholynewcollection_0_shard2_replica5
[junit4] 2> 2552451 T5308 C1196 P53563 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2552451 T5307 C1207 P53567 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2552457 T5307 C1207 P53567 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2552458 T5308 C1196 P53563 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2552458 T5307 C1207 P53567 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2552459 T5307 C1207 P53567 oasup.LogUpdateProcessor.finish [awholynewcollection_0_shard5_replica1] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 81
[junit4] 2> 2552447 T5306 C1190 P53573 oasc.RecoveryStrategy.replay No replay needed. core=awholynewcollection_0_shard1_replica4
[junit4] 2> 2552461 T5306 C1190 P53573 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=awholynewcollection_0_shard1_replica4
[junit4] 2> 2552461 T5306 C1190 P53573 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica4 state=active
[junit4] 2> 2552462 T5292 C1205 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard4_replica1] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2552464 T5308 C1196 P53563 oasc.RecoveryStrategy.replay No replay needed. core=awholynewcollection_0_shard4_replica5
[junit4] 2> 2552464 T5308 C1196 P53563 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=awholynewcollection_0_shard4_replica5
[junit4] 2> 2552465 T5308 C1196 P53563 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica5 state=active
[junit4] 2> 2552443 T5311 C1191 P53563 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=awholynewcollection_0_shard1_replica5
[junit4] 2> 2552442 T5303 C1198 P53576 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=awholynewcollection_0_shard4_replica3
[junit4] 2> 2552441 T5302 C1201 P53573 oasc.RecoveryStrategy.replay No replay needed. core=awholynewcollection_0_shard4_replica4
[junit4] 2> 2552469 T5302 C1201 P53573 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=awholynewcollection_0_shard4_replica4
[junit4] 2> 2552470 T5302 C1201 P53573 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica4 state=active
[junit4] 2> 2552468 T5308 C1196 P53563 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=awholynewcollection_0_shard4_replica5
[junit4] 2> 2552471 T5114 oasc.RecoveryStrategy.close WARN Stopping recovery for zkNodeName=core_node25core=awholynewcollection_0_shard5_replica5
[junit4] 2> 2552467 T5306 C1190 P53573 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=awholynewcollection_0_shard1_replica4
[junit4] 2> 2552461 T5301 C1195 P53573 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2552457 T5148 C1207 P53567 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2552475 T5148 C1207 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard5_replica1] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=19
[junit4] 2> 2552455 T5309 C1194 P53563 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2552477 T5309 C1194 P53563 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2552476 T5300 C1193 P53570 oasc.RecoveryStrategy.replay No replay needed. core=awholynewcollection_0_shard5_replica2
[junit4] 2> 2552478 T5300 C1193 P53570 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=awholynewcollection_0_shard5_replica2
[junit4] 2> 2552478 T5300 C1193 P53570 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica2 state=active
[junit4] 2> 2552473 T5301 C1195 P53573 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2552472 T5302 C1201 P53573 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=awholynewcollection_0_shard4_replica4
[junit4] 2> 2552481 T5147 C1207 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard5_replica1] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2552482 T5300 C1193 P53570 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=awholynewcollection_0_shard5_replica2
[junit4] 2> 2552483 T5149 C1207 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard5_replica1] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2552483 T5309 C1194 P53563 oasc.RecoveryStrategy.replay No replay needed. core=awholynewcollection_0_shard5_replica5
[junit4] 2> 2552485 T5309 C1194 P53563 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=awholynewcollection_0_shard5_replica5
[junit4] 2> 2552485 T5309 C1194 P53563 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica5 state=active
[junit4] 2> 2552485 T5301 C1195 P53573 oasc.RecoveryStrategy.replay No replay needed. core=awholynewcollection_0_shard5_replica4
[junit4] 2> 2552487 T5301 C1195 P53573 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=awholynewcollection_0_shard5_replica4
[junit4] 2> 2552488 T5301 C1195 P53573 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica4 state=active
[junit4] 2> 2552488 T5309 C1194 P53563 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=awholynewcollection_0_shard5_replica5
[junit4] 2> 2552491 T5301 C1195 P53573 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=awholynewcollection_0_shard5_replica4
[junit4] 2> 2552491 T5114 oasc.SolrCore.close [awholynewcollection_0_shard4_replica5] CLOSING SolrCore org.apache.solr.core.SolrCore@5b64229
[junit4] 2> 2552515 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2552516 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2552517 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2552518 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2552519 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard4_replica5] Closing main searcher on request.
[junit4] 2> 2552520 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2552521 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard4_replica5/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard4_replica5/data/index;done=false>>]
[junit4] 2> 2552524 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard4_replica5/data/index
[junit4] 2> 2552528 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard4_replica5/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard4_replica5/data;done=false>>]
[junit4] 2> 2552528 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard4_replica5/data
[junit4] 2> 2552529 T5114 oasc.SolrCore.close [awholynewcollection_0_shard3_replica5] CLOSING SolrCore org.apache.solr.core.SolrCore@6ab81731
[junit4] 2> 2552549 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2552550 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2552550 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2552550 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2552551 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard3_replica5] Closing main searcher on request.
[junit4] 2> 2552552 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2552552 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard3_replica5/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard3_replica5/data/index;done=false>>]
[junit4] 2> 2552553 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard3_replica5/data/index
[junit4] 2> 2552553 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard3_replica5/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard3_replica5/data;done=false>>]
[junit4] 2> 2552554 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard3_replica5/data
[junit4] 2> 2552554 T5114 oasc.SolrCore.close [awholynewcollection_0_shard2_replica5] CLOSING SolrCore org.apache.solr.core.SolrCore@1edc8b49
[junit4] 2> 2552567 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2552568 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2552568 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2552569 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2552570 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard2_replica5] Closing main searcher on request.
[junit4] 2> 2552570 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2552570 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard2_replica5/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard2_replica5/data;done=false>>]
[junit4] 2> 2552571 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard2_replica5/data
[junit4] 2> 2552571 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard2_replica5/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard2_replica5/data/index;done=false>>]
[junit4] 2> 2552572 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard2_replica5/data/index
[junit4] 2> 2552572 T5114 oasc.SolrCore.close [awholynewcollection_0_shard1_replica5] CLOSING SolrCore org.apache.solr.core.SolrCore@5e80bc2d
[junit4] 2> 2552586 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2552587 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2552588 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2552588 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2552590 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard1_replica5] Closing main searcher on request.
[junit4] 2> 2552591 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2552592 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard1_replica5/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard1_replica5/data;done=false>>]
[junit4] 2> 2552593 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard1_replica5/data
[junit4] 2> 2552594 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard1_replica5/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard1_replica5/data/index;done=false>>]
[junit4] 2> 2552595 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard1_replica5/data/index
[junit4] 2> 2552596 T5114 oasc.SolrCore.close [awholynewcollection_0_shard5_replica5] CLOSING SolrCore org.apache.solr.core.SolrCore@7e46dce
[junit4] 2> 2552615 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2552616 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2552616 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2552618 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2552623 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard5_replica5] Closing main searcher on request.
[junit4] 2> 2552624 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2552625 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard5_replica5/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard5_replica5/data/index;done=false>>]
[junit4] 2> 2552626 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard5_replica5/data/index
[junit4] 2> 2552626 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard5_replica5/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard5_replica5/data;done=false>>]
[junit4] 2> 2552627 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373991680293//awholynewcollection_0_shard5_replica5/data
[junit4] 2> 2552647 T5137 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=90045918743494659-127.0.0.1:53563_dx_sd-n_0000000000) am no longer a leader.
[junit4] 2> 2552653 T5168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2552653 T5136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2552654 T5136 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2552655 T5136 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2552662 T5182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4] 2> 2552663 T5154 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2552663 T5196 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2552665 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 2552666 T5168 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2552680 T5182 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2552681 T5154 oasc.Overseer.start Overseer (id=90045918743494662-127.0.0.1:53567_dx_sd-n_0000000001) starting
[junit4] 2> 2552710 T5114 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/dx_sd,null}
[junit4] 2> 2552718 T5331 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2552721 T5154 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2552722 T5154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 2552733 T5330 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2552739 T5330 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2552741 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2552753 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2552764 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node8",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2552774 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node18",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2552777 T5114 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 53567
[junit4] 2> 2552777 T5114 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=2020173495
[junit4] 2> 2552790 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node9",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53563_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53563/dx_sd"}
[junit4] 2> 2552801 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node17",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2552817 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node13",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53563_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53563/dx_sd"}
[junit4] 2> 2552833 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2552846 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node20",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53563_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53563/dx_sd"}
[junit4] 2> 2552857 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node19",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> C1200_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard2_replica1 props:{state=recovering, core=awholynewcollection_0_shard2_replica1, node_name=127.0.0.1:53567_dx_sd, base_url=http://127.0.0.1:53567/dx_sd}
[junit4] 2> 2552859 T5297 C1200 P53567 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard2_replica2/ core=awholynewcollection_0_shard2_replica1 - recoveringAfterStartup=true
[junit4] 2> 2552863 T5297 C1200 P53567 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard2_replica1 url=http://127.0.0.1:53567/dx_sd START replicas=[http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard2_replica2/] nUpdates=100
[junit4] 2> 2552864 T5297 C1200 P53567 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2552864 T5297 C1200 P53567 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=awholynewcollection_0_shard2_replica1
[junit4] 2> 2552864 T5297 C1200 P53567 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=awholynewcollection_0_shard2_replica1
[junit4] 2> 2552865 T5297 C1200 P53567 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=awholynewcollection_0_shard2_replica1
[junit4] 2> 2552865 T5297 C1200 P53567 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2552865 T5297 C1200 P53567 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard2_replica2/. core=awholynewcollection_0_shard2_replica1
[junit4] 2> 2552866 T5297 C1200 P53567 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2552867 T5163 C1206 P53570 oasc.SolrCore.execute [awholynewcollection_0_shard2_replica2] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2552876 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node23",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> C1192_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard5_replica3 props:{state=recovering, core=awholynewcollection_0_shard5_replica3, node_name=127.0.0.1:53576_dx_sd, base_url=http://127.0.0.1:53576/dx_sd}
[junit4] 2> 2552878 T5296 C1192 P53576 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1/ core=awholynewcollection_0_shard5_replica3 - recoveringAfterStartup=true
[junit4] 2> 2552879 T5296 C1192 P53576 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard5_replica3 url=http://127.0.0.1:53576/dx_sd START replicas=[http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1/] nUpdates=100
[junit4] 2> 2552879 T5296 C1192 P53576 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2552880 T5296 C1192 P53576 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=awholynewcollection_0_shard5_replica3
[junit4] 2> 2552880 T5296 C1192 P53576 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=awholynewcollection_0_shard5_replica3
[junit4] 2> 2552880 T5296 C1192 P53576 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=awholynewcollection_0_shard5_replica3
[junit4] 2> 2552880 T5296 C1192 P53576 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2552881 T5296 C1192 P53576 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1/. core=awholynewcollection_0_shard5_replica3
[junit4] 2> 2552881 T5296 C1192 P53576 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2552886 T5238 C1207 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard5_replica1] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2552894 T5161 C1206 P53570 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2552894 T5161 C1206 P53570 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2552904 T5161 C1206 P53570 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2552904 T5161 C1206 P53570 oasup.LogUpdateProcessor.finish [awholynewcollection_0_shard2_replica2] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 11
[junit4] 2> 2552907 T5147 C1207 P53567 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2552907 T5147 C1207 P53567 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2552908 T5147 C1207 P53567 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2552908 T5147 C1207 P53567 oasup.LogUpdateProcessor.finish [awholynewcollection_0_shard5_replica1] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 1
[junit4] 2> 2552911 T5297 C1200 P53567 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2552911 T5297 C1200 P53567 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2552912 T5296 C1192 P53576 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2552913 T5296 C1192 P53576 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2552915 T5162 C1206 P53570 oasc.SolrCore.execute [awholynewcollection_0_shard2_replica2] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 2552915 T5149 C1207 P53567 oasc.SolrCore.execute [awholynewcollection_0_shard5_replica1] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2552916 T5297 C1200 P53567 oasc.RecoveryStrategy.replay No replay needed. core=awholynewcollection_0_shard2_replica1
[junit4] 2> 2552916 T5297 C1200 P53567 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=awholynewcollection_0_shard2_replica1
[junit4] 2> 2552917 T5297 C1200 P53567 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica1 state=active
[junit4] 2> 2552917 T5296 C1192 P53576 oasc.RecoveryStrategy.replay No replay needed. core=awholynewcollection_0_shard5_replica3
[junit4] 2> 2552918 T5296 C1192 P53576 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=awholynewcollection_0_shard5_replica3
[junit4] 2> 2552918 T5296 C1192 P53576 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica3 state=active
[junit4] 2> 2552921 T5296 C1192 P53576 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=awholynewcollection_0_shard5_replica3
[junit4] 2> 2552921 T5297 C1200 P53567 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=awholynewcollection_0_shard2_replica1
[junit4] 2> 2552921 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node25",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53563_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53563/dx_sd"}
[junit4] 2> C1199_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard2_replica3 props:{state=recovering, core=awholynewcollection_0_shard2_replica3, node_name=127.0.0.1:53576_dx_sd, base_url=http://127.0.0.1:53576/dx_sd}
[junit4] 2> 2552925 T5295 C1199 P53576 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard2_replica2/ core=awholynewcollection_0_shard2_replica3 - recoveringAfterStartup=true
[junit4] 2> 2552926 T5295 C1199 P53576 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard2_replica3 url=http://127.0.0.1:53576/dx_sd START replicas=[http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard2_replica2/] nUpdates=100
[junit4] 2> 2552926 T5295 C1199 P53576 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 2552927 T5295 C1199 P53576 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=awholynewcollection_0_shard2_replica3
[junit4] 2> 2552927 T5295 C1199 P53576 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=awholynewcollection_0_shard2_replica3
[junit4] 2> 2552927 T5295 C1199 P53576 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=awholynewcollection_0_shard2_replica3
[junit4] 2> 2552927 T5295 C1199 P53576 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 2552928 T5295 C1199 P53576 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard2_replica2/. core=awholynewcollection_0_shard2_replica3
[junit4] 2> 2552928 T5295 C1199 P53576 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 2552940 T5159 C1206 P53570 oasc.SolrCore.execute [awholynewcollection_0_shard2_replica2] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2552947 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node24",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2552951 T5164 C1206 P53570 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2552952 T5164 C1206 P53570 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2552953 T5164 C1206 P53570 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2552954 T5164 C1206 P53570 oasup.LogUpdateProcessor.finish [awholynewcollection_0_shard2_replica2] webapp=/dx_sd path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 3
[junit4] 2> 2552957 T5295 C1199 P53576 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2552957 T5295 C1199 P53576 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 2552963 T5161 C1206 P53570 oasc.SolrCore.execute [awholynewcollection_0_shard2_replica2] webapp=/dx_sd path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2552965 T5295 C1199 P53576 oasc.RecoveryStrategy.replay No replay needed. core=awholynewcollection_0_shard2_replica3
[junit4] 2> 2552966 T5295 C1199 P53576 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=awholynewcollection_0_shard2_replica3
[junit4] 2> 2552966 T5295 C1199 P53576 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica3 state=active
[junit4] 2> 2552968 T5295 C1199 P53576 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=awholynewcollection_0_shard2_replica3
[junit4] 2> 2552977 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2552977 T5330 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2552986 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node5",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2552986 T5330 oasc.Overseer$ClusterStateUpdater.updateState shard=shard2 is already registered
[junit4] 2> 2553079 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node11",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2553080 T5330 oasc.Overseer$ClusterStateUpdater.updateState shard=shard3 is already registered
[junit4] 2> 2553090 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node16",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2553091 T5330 oasc.Overseer$ClusterStateUpdater.updateState shard=shard4 is already registered
[junit4] 2> 2553100 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node21",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2553100 T5330 oasc.Overseer$ClusterStateUpdater.updateState shard=shard5 is already registered
[junit4] 2> 2553110 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2553110 T5330 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2553121 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node22",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2553134 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node5",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2553145 T5330 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node6",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2553156 T5168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 2553157 T5182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 2553157 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 2553156 T5154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 2582857 T5114 oasc.ZkController.publishAndWaitForDownStates WARN Timed out waiting to see all nodes published as DOWN in our cluster state.
[junit4] 2> 2582860 T5114 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=down
[junit4] 2> 2582864 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica1 state=down
[junit4] 2> 2582868 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica1 state=down
[junit4] 2> 2582870 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica1 state=down
[junit4] 2> 2582874 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica1 state=down
[junit4] 2> 2582879 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica1 state=down
[junit4] 2> 2582883 T5114 oasc.SolrCore.close [nodes_used_collection_shard1_replica2] CLOSING SolrCore org.apache.solr.core.SolrCore@5d7f12f3
[junit4] 2> 2582904 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2582905 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2582905 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2582906 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2582909 T5114 oasc.SolrCore.closeSearcher [nodes_used_collection_shard1_replica2] Closing main searcher on request.
[junit4] 2> 2582909 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2582910 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//nodes_used_collection_shard1_replica2/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//nodes_used_collection_shard1_replica2/data;done=false>>]
[junit4] 2> 2582910 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//nodes_used_collection_shard1_replica2/data
[junit4] 2> 2582911 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//nodes_used_collection_shard1_replica2/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//nodes_used_collection_shard1_replica2/data/index;done=false>>]
[junit4] 2> 2582911 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//nodes_used_collection_shard1_replica2/data/index
[junit4] 2> 2582912 T5114 oasc.SolrCore.close [awholynewcollection_0_shard4_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@39067512
[junit4] 2> 2582942 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2582943 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2582943 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2582944 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2582947 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard4_replica1] Closing main searcher on request.
[junit4] 2> 2582948 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2582948 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard4_replica1/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard4_replica1/data;done=false>>]
[junit4] 2> 2582949 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard4_replica1/data
[junit4] 2> 2582950 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard4_replica1/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard4_replica1/data/index;done=false>>]
[junit4] 2> 2582950 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard4_replica1/data/index
[junit4] 2> 2582951 T5114 oasc.SolrCore.close [awholynewcollection_0_shard3_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@1c8cbb71
[junit4] 2> 2582977 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2582978 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2582979 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2582979 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2582982 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard3_replica1] Closing main searcher on request.
[junit4] 2> 2582984 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2582984 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard3_replica1/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard3_replica1/data;done=false>>]
[junit4] 2> 2582985 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard3_replica1/data
[junit4] 2> 2582986 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard3_replica1/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard3_replica1/data/index;done=false>>]
[junit4] 2> 2582986 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard3_replica1/data/index
[junit4] 2> 2582987 T5114 oasc.SolrCore.close [awholynewcollection_0_shard1_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@2cfe4db7
[junit4] 2> 2583011 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2583012 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2583013 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2583014 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2583015 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard1_replica1] Closing main searcher on request.
[junit4] 2> 2583016 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2583017 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard1_replica1/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard1_replica1/data;done=false>>]
[junit4] 2> 2583017 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard1_replica1/data
[junit4] 2> 2583018 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard1_replica1/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard1_replica1/data/index;done=false>>]
[junit4] 2> 2583019 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard1_replica1/data/index
[junit4] 2> 2583020 T5114 oasc.SolrCore.close [awholynewcollection_0_shard5_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@38d0bf14
[junit4] 2> 2583036 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2583037 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2583037 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2583038 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2583041 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard5_replica1] Closing main searcher on request.
[junit4] 2> 2583042 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2583043 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard5_replica1/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard5_replica1/data/index;done=false>>]
[junit4] 2> 2583044 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard5_replica1/data/index
[junit4] 2> 2583045 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard5_replica1/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard5_replica1/data;done=false>>]
[junit4] 2> 2583046 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard5_replica1/data
[junit4] 2> 2583047 T5114 oasc.SolrCore.close [awholynewcollection_0_shard2_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@4c9dcc39
[junit4] 2> 2583070 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2583073 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2583074 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2583074 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2583075 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard2_replica1] Closing main searcher on request.
[junit4] 2> 2583076 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2583077 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard2_replica1/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard2_replica1/data;done=false>>]
[junit4] 2> 2583078 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard2_replica1/data
[junit4] 2> 2583078 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard2_replica1/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard2_replica1/data/index;done=false>>]
[junit4] 2> 2583079 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373991681462//awholynewcollection_0_shard2_replica1/data/index
[junit4] 2> 2583083 T5330 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=90045918743494662-127.0.0.1:53567_dx_sd-n_0000000001) am no longer a leader.
[junit4] 2> 2583092 T5182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 2583097 T5196 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2583097 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2583100 T5168 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard5
[junit4] 2> 2583101 T5182 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2583107 T5196 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 2583107 T5168 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4] 2> 2583108 T5168 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4] 2> 2583109 T5168 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 2583109 T5168 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard5_replica2/
[junit4] 2> 2583110 T5168 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard5_replica2 url=http://127.0.0.1:53570/dx_sd START replicas=[http://127.0.0.1:53567/dx_sd/awholynewcollection_0_shard5_replica1/, http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard5_replica3/, http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard5_replica4/] nUpdates=100
[junit4] 2> 2583112 T5168 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard5_replica2 url=http://127.0.0.1:53570/dx_sd DONE. We have no versions. sync failed.
[junit4] 2> 2583113 T5168 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2583113 T5168 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2583114 T5168 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard5_replica2/ shard5
[junit4] 2> 2583114 T5168 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leaders/shard5
[junit4] 2> ASYNC NEW_CORE C1209 name=awholynewcollection_0_shard5_replica3 org.apache.solr.core.SolrCore@6234709d url=http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard5_replica3 node=127.0.0.1:53576_dx_sd C1209_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard5_replica3 props:{state=active, core=awholynewcollection_0_shard5_replica3, node_name=127.0.0.1:53576_dx_sd, base_url=http://127.0.0.1:53576/dx_sd}
[junit4] 2> 2583115 T5192 C1209 P53576 oasc.SolrCore.execute [awholynewcollection_0_shard5_replica3] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> ASYNC NEW_CORE C1210 name=awholynewcollection_0_shard5_replica4 org.apache.solr.core.SolrCore@5d5818cf url=http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard5_replica4 node=127.0.0.1:53573_dx_sd C1210_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard5_replica4 props:{state=active, core=awholynewcollection_0_shard5_replica4, node_name=127.0.0.1:53573_dx_sd, base_url=http://127.0.0.1:53573/dx_sd}
[junit4] 2> 2583117 T5175 C1210 P53573 oasc.SolrCore.execute [awholynewcollection_0_shard5_replica4] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2583118 T5196 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4] 2> 2583119 T5196 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4] 2> 2583119 T5196 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 2583119 T5196 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard3_replica3/
[junit4] 2> 2583120 T5196 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard3_replica3 url=http://127.0.0.1:53576/dx_sd START replicas=[http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard3_replica2/, http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard3_replica4/] nUpdates=100
[junit4] 2> 2583122 T5196 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard3_replica3 url=http://127.0.0.1:53576/dx_sd DONE. We have no versions. sync failed.
[junit4] 2> 2583123 T5196 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2583123 T5196 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2583123 T5196 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard3_replica3/ shard3
[junit4] 2> 2583124 T5196 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leaders/shard3
[junit4] 2> ASYNC NEW_CORE C1211 name=awholynewcollection_0_shard3_replica2 org.apache.solr.core.SolrCore@72dac7b url=http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard3_replica2 node=127.0.0.1:53570_dx_sd C1211_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard3_replica2 props:{state=active, core=awholynewcollection_0_shard3_replica2, node_name=127.0.0.1:53570_dx_sd, base_url=http://127.0.0.1:53570/dx_sd}
[junit4] 2> 2583125 T5162 C1211 P53570 oasc.SolrCore.execute [awholynewcollection_0_shard3_replica2] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> ASYNC NEW_CORE C1212 name=awholynewcollection_0_shard3_replica4 org.apache.solr.core.SolrCore@747e4fc9 url=http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard3_replica4 node=127.0.0.1:53573_dx_sd C1212_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard3_replica4 props:{state=active, core=awholynewcollection_0_shard3_replica4, node_name=127.0.0.1:53573_dx_sd, base_url=http://127.0.0.1:53573/dx_sd}
[junit4] 2> 2583126 T5173 C1212 P53573 oasc.SolrCore.execute [awholynewcollection_0_shard3_replica4] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2583144 T5168 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2583146 T5196 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard4
[junit4] 2> 2583154 T5168 oasc.Overseer.start Overseer (id=90045918743494664-127.0.0.1:53570_dx_sd-n_0000000002) starting
[junit4] 2> 2583156 T5196 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4] 2> 2583157 T5196 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4] 2> 2583157 T5196 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 2583157 T5196 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard4_replica3/
[junit4] 2> 2583158 T5196 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard4_replica3 url=http://127.0.0.1:53576/dx_sd START replicas=[http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard4_replica2/, http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard4_replica4/] nUpdates=100
[junit4] 2> 2583159 T5114 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/dx_sd,null}
[junit4] 2> 2583162 T5196 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard4_replica3 url=http://127.0.0.1:53576/dx_sd DONE. We have no versions. sync failed.
[junit4] 2> 2583162 T5196 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2583162 T5196 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2583163 T5196 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard4_replica3/ shard4
[junit4] 2> 2583164 T5196 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leaders/shard4
[junit4] 2> ASYNC NEW_CORE C1213 name=awholynewcollection_0_shard4_replica2 org.apache.solr.core.SolrCore@4f9161fa url=http://127.0.0.1:53570/dx_sd/awholynewcollection_0_shard4_replica2 node=127.0.0.1:53570_dx_sd C1213_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard4_replica2 props:{state=active, core=awholynewcollection_0_shard4_replica2, node_name=127.0.0.1:53570_dx_sd, base_url=http://127.0.0.1:53570/dx_sd}
[junit4] 2> 2583168 T5159 C1213 P53570 oasc.SolrCore.execute [awholynewcollection_0_shard4_replica2] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> ASYNC NEW_CORE C1214 name=awholynewcollection_0_shard4_replica4 org.apache.solr.core.SolrCore@432b8313 url=http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard4_replica4 node=127.0.0.1:53573_dx_sd C1214_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard4_replica4 props:{state=active, core=awholynewcollection_0_shard4_replica4, node_name=127.0.0.1:53573_dx_sd, base_url=http://127.0.0.1:53573/dx_sd}
[junit4] 2> 2583171 T5176 C1214 P53573 oasc.SolrCore.execute [awholynewcollection_0_shard4_replica4] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2583177 T5168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 2583178 T5343 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2583184 T5168 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2583186 T5342 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2583188 T5168 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 2583197 T5342 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2583198 T5168 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4] 2> 2583198 T5168 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4] 2> 2583198 T5168 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 2583199 T5168 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53570/dx_sd/nodes_used_collection_shard1_replica1/
[junit4] 2> 2583199 T5168 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2583199 T5168 oasc.SyncStrategy.syncToMe http://127.0.0.1:53570/dx_sd/nodes_used_collection_shard1_replica1/ has no replicas
[junit4] 2> 2583200 T5168 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53570/dx_sd/nodes_used_collection_shard1_replica1/ shard1
[junit4] 2> 2583200 T5342 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2583208 T5168 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard1
[junit4] 2> 2583220 T5114 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 53570
[junit4] 2> 2583222 T5114 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=776129677
[junit4] 2> 2583235 T5342 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node16",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2583253 T5342 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node11",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2583263 T5342 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2583272 T5342 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node21",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2583296 T5342 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node5",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53567_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53567/dx_sd"}
[junit4] 2> 2583365 T5342 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2583366 T5342 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2583374 T5342 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node7",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2583375 T5342 oasc.Overseer$ClusterStateUpdater.updateState shard=shard2 is already registered
[junit4] 2> 2583389 T5342 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node10",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2583390 T5342 oasc.Overseer$ClusterStateUpdater.updateState shard=shard3 is already registered
[junit4] 2> 2583410 T5342 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node17",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2583410 T5342 oasc.Overseer$ClusterStateUpdater.updateState shard=shard4 is already registered
[junit4] 2> 2583419 T5342 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node23",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2583420 T5342 oasc.Overseer$ClusterStateUpdater.updateState shard=shard5 is already registered
[junit4] 2> 2583429 T5342 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2583429 T5342 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2583440 T5182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2583441 T5168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2583440 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2584393 T5154 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2584400 T5154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 2584401 T5154 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2585253 T5114 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=down
[junit4] 2> 2585258 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica2 state=down
[junit4] 2> 2585262 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica2 state=down
[junit4] 2> 2585269 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica2 state=down
[junit4] 2> 2585273 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica2 state=down
[junit4] 2> 2585277 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica2 state=down
[junit4] 2> 2585282 T5114 oasc.SolrCore.close [nodes_used_collection_shard1_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@3e70aed6
[junit4] 2> 2585305 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2585306 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2585307 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2585308 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2585309 T5114 oasc.SolrCore.closeSearcher [nodes_used_collection_shard1_replica1] Closing main searcher on request.
[junit4] 2> 2585310 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2585311 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//nodes_used_collection_shard1_replica1/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//nodes_used_collection_shard1_replica1/data/index;done=false>>]
[junit4] 2> 2585313 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//nodes_used_collection_shard1_replica1/data/index
[junit4] 2> 2585317 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//nodes_used_collection_shard1_replica1/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//nodes_used_collection_shard1_replica1/data;done=false>>]
[junit4] 2> 2585320 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//nodes_used_collection_shard1_replica1/data
[junit4] 2> 2585329 T5114 oasc.SolrCore.close [awholynewcollection_0_shard2_replica2] CLOSING SolrCore org.apache.solr.core.SolrCore@5e053cfd
[junit4] 2> 2585352 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2585354 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2585354 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2585355 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2585359 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard2_replica2] Closing main searcher on request.
[junit4] 2> 2585361 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2585362 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard2_replica2/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard2_replica2/data/index;done=false>>]
[junit4] 2> 2585363 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard2_replica2/data/index
[junit4] 2> 2585364 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard2_replica2/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard2_replica2/data;done=false>>]
[junit4] 2> 2585365 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard2_replica2/data
[junit4] 2> 2585365 T5114 oasc.SolrCore.close [awholynewcollection_0_shard1_replica2] CLOSING SolrCore org.apache.solr.core.SolrCore@5065ea69
[junit4] 2> 2585379 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2585380 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2585380 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2585381 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2585382 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard1_replica2] Closing main searcher on request.
[junit4] 2> 2585382 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2585382 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard1_replica2/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard1_replica2/data;done=false>>]
[junit4] 2> 2585383 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard1_replica2/data
[junit4] 2> 2585383 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard1_replica2/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard1_replica2/data/index;done=false>>]
[junit4] 2> 2585383 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard1_replica2/data/index
[junit4] 2> 2585384 T5114 oasc.SolrCore.close [awholynewcollection_0_shard4_replica2] CLOSING SolrCore org.apache.solr.core.SolrCore@4f9161fa
[junit4] 2> 2585394 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2585395 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2585395 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2585395 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2585396 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard4_replica2] Closing main searcher on request.
[junit4] 2> 2585397 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2585398 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard4_replica2/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard4_replica2/data/index;done=false>>]
[junit4] 2> 2585399 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard4_replica2/data/index
[junit4] 2> 2585399 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard4_replica2/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard4_replica2/data;done=false>>]
[junit4] 2> 2585400 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard4_replica2/data
[junit4] 2> 2585400 T5114 oasc.SolrCore.close [awholynewcollection_0_shard5_replica2] CLOSING SolrCore org.apache.solr.core.SolrCore@2a25a35b
[junit4] 2> 2585414 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2585414 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2585415 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2585415 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2585416 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard5_replica2] Closing main searcher on request.
[junit4] 2> 2585418 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2585419 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard5_replica2/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard5_replica2/data;done=false>>]
[junit4] 2> 2585419 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard5_replica2/data
[junit4] 2> 2585422 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard5_replica2/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard5_replica2/data/index;done=false>>]
[junit4] 2> 2585427 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard5_replica2/data/index
[junit4] 2> 2585430 T5114 oasc.SolrCore.close [awholynewcollection_0_shard3_replica2] CLOSING SolrCore org.apache.solr.core.SolrCore@72dac7b
[junit4] 2> 2585444 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2585445 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2585446 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2585446 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2585447 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard3_replica2] Closing main searcher on request.
[junit4] 2> 2585448 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2585449 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard3_replica2/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard3_replica2/data/index;done=false>>]
[junit4] 2> 2585449 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard3_replica2/data/index
[junit4] 2> 2585450 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard3_replica2/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard3_replica2/data;done=false>>]
[junit4] 2> 2585450 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373991683480//awholynewcollection_0_shard3_replica2/data
[junit4] 2> 2585452 T5342 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=90045918743494664-127.0.0.1:53570_dx_sd-n_0000000002) am no longer a leader.
[junit4] 2> 2585456 T5168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2585457 T5182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2585461 T5196 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2585462 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2585466 T5182 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2585472 T5196 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard5
[junit4] 2> 2585478 T5182 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2585480 T5196 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4] 2> 2585480 T5196 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4] 2> 2585481 T5196 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 2585481 T5196 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard5_replica3/
[junit4] 2> 2585482 T5196 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard5_replica3 url=http://127.0.0.1:53576/dx_sd START replicas=[http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard5_replica4/] nUpdates=100
[junit4] 2> 2585484 T5196 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard5_replica3 url=http://127.0.0.1:53576/dx_sd DONE. We have no versions. sync failed.
[junit4] 2> 2585484 T5196 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2585485 T5196 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2585486 T5196 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard5_replica3/ shard5
[junit4] 2> 2585486 T5196 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leaders/shard5
[junit4] 2> 2585488 T5176 C1210 P53573 oasc.SolrCore.execute [awholynewcollection_0_shard5_replica4] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2585497 T5182 oasc.Overseer.start Overseer (id=90045918743494666-127.0.0.1:53573_dx_sd-n_0000000003) starting
[junit4] 2> 2585518 T5346 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2585520 T5196 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 2585523 T5345 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2585530 T5114 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/dx_sd,null}
[junit4] 2> 2585536 T5196 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4] 2> 2585537 T5196 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4] 2> 2585538 T5196 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 2585538 T5196 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard2_replica3/
[junit4] 2> 2585539 T5196 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard2_replica3 url=http://127.0.0.1:53576/dx_sd START replicas=[http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard2_replica4/] nUpdates=100
[junit4] 2> 2585540 T5196 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard2_replica3 url=http://127.0.0.1:53576/dx_sd DONE. We have no versions. sync failed.
[junit4] 2> 2585541 T5196 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2585541 T5196 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2585542 T5196 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53576/dx_sd/awholynewcollection_0_shard2_replica3/ shard2
[junit4] 2> 2585542 T5196 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leaders/shard2
[junit4] 2> ASYNC NEW_CORE C1215 name=awholynewcollection_0_shard2_replica4 org.apache.solr.core.SolrCore@4faf5dfb url=http://127.0.0.1:53573/dx_sd/awholynewcollection_0_shard2_replica4 node=127.0.0.1:53573_dx_sd C1215_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard2_replica4 props:{state=active, core=awholynewcollection_0_shard2_replica4, node_name=127.0.0.1:53573_dx_sd, base_url=http://127.0.0.1:53573/dx_sd}
[junit4] 2> 2585544 T5178 C1215 P53573 oasc.SolrCore.execute [awholynewcollection_0_shard2_replica4] webapp=/dx_sd path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 2585547 T5345 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2585553 T5345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2585572 T5345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node7",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2585598 T5114 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 53573
[junit4] 2> 2585599 T5114 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=2064357773
[junit4] 2> 2585615 T5345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2585631 T5345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node17",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2585642 T5345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node23",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2585654 T5345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node10",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53570_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53570/dx_sd"}
[junit4] 2> 2585718 T5345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2585719 T5345 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2585733 T5345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node8",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2585734 T5345 oasc.Overseer$ClusterStateUpdater.updateState shard=shard2 is already registered
[junit4] 2> 2585753 T5345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node14",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2585754 T5345 oasc.Overseer$ClusterStateUpdater.updateState shard=shard3 is already registered
[junit4] 2> 2585768 T5345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node19",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2585769 T5345 oasc.Overseer$ClusterStateUpdater.updateState shard=shard4 is already registered
[junit4] 2> 2585784 T5345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node24",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2585784 T5345 oasc.Overseer$ClusterStateUpdater.updateState shard=shard5 is already registered
[junit4] 2> 2585798 T5345 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2585799 T5345 oasc.Overseer$ClusterStateUpdater.updateState shard=shard2 is already registered
[junit4] 2> 2585813 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2585814 T5182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2586758 T5168 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2586758 T5168 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2587627 T5114 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=down
[junit4] 2> 2587631 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica4 state=down
[junit4] 2> 2587635 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica4 state=down
[junit4] 2> 2587639 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica4 state=down
[junit4] 2> 2587644 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica4 state=down
[junit4] 2> 2587648 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica4 state=down
[junit4] 2> 2587653 T5114 oasc.SolrCore.close [nodes_used_collection_shard2_replica2] CLOSING SolrCore org.apache.solr.core.SolrCore@772dd276
[junit4] 2> 2587677 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2587678 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2587678 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2587679 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2587680 T5114 oasc.SolrCore.closeSearcher [nodes_used_collection_shard2_replica2] Closing main searcher on request.
[junit4] 2> 2587681 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2587685 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//nodes_used_collection_shard2_replica2/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//nodes_used_collection_shard2_replica2/data;done=false>>]
[junit4] 2> 2587688 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//nodes_used_collection_shard2_replica2/data
[junit4] 2> 2587689 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//nodes_used_collection_shard2_replica2/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//nodes_used_collection_shard2_replica2/data/index;done=false>>]
[junit4] 2> 2587691 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//nodes_used_collection_shard2_replica2/data/index
[junit4] 2> 2587692 T5114 oasc.SolrCore.close [awholynewcollection_0_shard1_replica4] CLOSING SolrCore org.apache.solr.core.SolrCore@6a9f136
[junit4] 2> 2587718 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2587720 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2587721 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2587722 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2587723 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard1_replica4] Closing main searcher on request.
[junit4] 2> 2587724 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2587724 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard1_replica4/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard1_replica4/data;done=false>>]
[junit4] 2> 2587725 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard1_replica4/data
[junit4] 2> 2587725 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard1_replica4/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard1_replica4/data/index;done=false>>]
[junit4] 2> 2587726 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard1_replica4/data/index
[junit4] 2> 2587726 T5114 oasc.SolrCore.close [awholynewcollection_0_shard3_replica4] CLOSING SolrCore org.apache.solr.core.SolrCore@747e4fc9
[junit4] 2> 2587753 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2587754 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2587755 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2587756 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2587758 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard3_replica4] Closing main searcher on request.
[junit4] 2> 2587759 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2587760 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard3_replica4/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard3_replica4/data/index;done=false>>]
[junit4] 2> 2587762 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard3_replica4/data/index
[junit4] 2> 2587763 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard3_replica4/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard3_replica4/data;done=false>>]
[junit4] 2> 2587764 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard3_replica4/data
[junit4] 2> 2587765 T5114 oasc.SolrCore.close [awholynewcollection_0_shard5_replica4] CLOSING SolrCore org.apache.solr.core.SolrCore@5d5818cf
[junit4] 2> 2587796 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2587797 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2587798 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2587799 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2587801 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard5_replica4] Closing main searcher on request.
[junit4] 2> 2587802 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2587803 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard5_replica4/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard5_replica4/data;done=false>>]
[junit4] 2> 2587805 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard5_replica4/data
[junit4] 2> 2587806 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard5_replica4/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard5_replica4/data/index;done=false>>]
[junit4] 2> 2587807 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard5_replica4/data/index
[junit4] 2> 2587808 T5114 oasc.SolrCore.close [awholynewcollection_0_shard2_replica4] CLOSING SolrCore org.apache.solr.core.SolrCore@4faf5dfb
[junit4] 2> 2587840 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2587842 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2587843 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2587844 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2587854 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard2_replica4] Closing main searcher on request.
[junit4] 2> 2587856 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2587857 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard2_replica4/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard2_replica4/data;done=false>>]
[junit4] 2> 2587858 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard2_replica4/data
[junit4] 2> 2587859 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard2_replica4/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard2_replica4/data/index;done=false>>]
[junit4] 2> 2587860 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard2_replica4/data/index
[junit4] 2> 2587861 T5114 oasc.SolrCore.close [awholynewcollection_0_shard4_replica4] CLOSING SolrCore org.apache.solr.core.SolrCore@432b8313
[junit4] 2> 2587883 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2587885 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2587886 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2587887 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2587889 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard4_replica4] Closing main searcher on request.
[junit4] 2> 2587890 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2587891 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard4_replica4/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard4_replica4/data/index;done=false>>]
[junit4] 2> 2587892 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard4_replica4/data/index
[junit4] 2> 2587894 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard4_replica4/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard4_replica4/data;done=false>>]
[junit4] 2> 2587894 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373991685597//awholynewcollection_0_shard4_replica4/data
[junit4] 2> 2587900 T5345 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=90045918743494666-127.0.0.1:53573_dx_sd-n_0000000003) am no longer a leader.
[junit4] 2> 2587906 T5182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2587910 T5196 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2587919 T5196 oasc.Overseer.start Overseer (id=90045918743494668-127.0.0.1:53576_dx_sd-n_0000000004) starting
[junit4] 2> 2587939 T5114 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/dx_sd,null}
[junit4] 2> 2587951 T5349 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2587956 T5196 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2587956 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2587971 T5348 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2587982 T5348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2587986 T5348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2587994 T5114 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 53576
[junit4] 2> 2587995 T5114 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1744918452
[junit4] 2> 2588004 T5348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2588021 T5348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node14",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2588033 T5348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node24",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2588045 T5348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node8",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2588057 T5348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node19",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:53573_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53573/dx_sd"}
[junit4] 2> 2588069 T5348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2588070 T5348 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2588083 T5348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node6",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2588084 T5348 oasc.Overseer$ClusterStateUpdater.updateState shard=shard2 is already registered
[junit4] 2> 2588107 T5348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node12",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2588107 T5348 oasc.Overseer$ClusterStateUpdater.updateState shard=shard3 is already registered
[junit4] 2> 2588124 T5348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node18",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2588125 T5348 oasc.Overseer$ClusterStateUpdater.updateState shard=shard4 is already registered
[junit4] 2> 2588135 T5348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node22",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2588136 T5348 oasc.Overseer$ClusterStateUpdater.updateState shard=shard5 is already registered
[junit4] 2> 2588146 T5348 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "node_name":"127.0.0.1:53576_dx_sd",
[junit4] 2> "base_url":"http://127.0.0.1:53576/dx_sd"}
[junit4] 2> 2588146 T5348 oasc.Overseer$ClusterStateUpdater.updateState shard=shard2 is already registered
[junit4] 2> 2588157 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2589209 T5182 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2589209 T5182 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2590024 T5114 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=down
[junit4] 2> 2590029 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica3 state=down
[junit4] 2> 2590034 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica3 state=down
[junit4] 2> 2590040 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica3 state=down
[junit4] 2> 2590045 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica3 state=down
[junit4] 2> 2590049 T5114 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica3 state=down
[junit4] 2> 2590055 T5114 oasc.SolrCore.close [nodes_used_collection_shard2_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@496b76e0
[junit4] 2> 2590081 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2590082 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2590083 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2590084 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2590093 T5114 oasc.SolrCore.closeSearcher [nodes_used_collection_shard2_replica1] Closing main searcher on request.
[junit4] 2> 2590098 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2590099 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//nodes_used_collection_shard2_replica1/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//nodes_used_collection_shard2_replica1/data/index;done=false>>]
[junit4] 2> 2590100 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//nodes_used_collection_shard2_replica1/data/index
[junit4] 2> 2590100 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//nodes_used_collection_shard2_replica1/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//nodes_used_collection_shard2_replica1/data;done=false>>]
[junit4] 2> 2590104 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//nodes_used_collection_shard2_replica1/data
[junit4] 2> 2590105 T5114 oasc.SolrCore.close [awholynewcollection_0_shard1_replica3] CLOSING SolrCore org.apache.solr.core.SolrCore@1550fd90
[junit4] 2> 2590119 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2590120 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2590120 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2590121 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2590123 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard1_replica3] Closing main searcher on request.
[junit4] 2> 2590124 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2590124 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard1_replica3/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard1_replica3/data;done=false>>]
[junit4] 2> 2590125 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard1_replica3/data
[junit4] 2> 2590126 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard1_replica3/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard1_replica3/data/index;done=false>>]
[junit4] 2> 2590127 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard1_replica3/data/index
[junit4] 2> 2590128 T5114 oasc.SolrCore.close [awholynewcollection_0_shard2_replica3] CLOSING SolrCore org.apache.solr.core.SolrCore@7beac168
[junit4] 2> 2590146 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2590147 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2590147 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2590148 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2590150 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard2_replica3] Closing main searcher on request.
[junit4] 2> 2590150 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2590151 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard2_replica3/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard2_replica3/data/index;done=false>>]
[junit4] 2> 2590152 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard2_replica3/data/index
[junit4] 2> 2590153 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard2_replica3/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard2_replica3/data;done=false>>]
[junit4] 2> 2590153 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard2_replica3/data
[junit4] 2> 2590154 T5114 oasc.SolrCore.close [awholynewcollection_0_shard4_replica3] CLOSING SolrCore org.apache.solr.core.SolrCore@523be601
[junit4] 2> 2590176 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2590178 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2590178 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2590179 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2590181 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard4_replica3] Closing main searcher on request.
[junit4] 2> 2590182 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2590183 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard4_replica3/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard4_replica3/data/index;done=false>>]
[junit4] 2> 2590184 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard4_replica3/data/index
[junit4] 2> 2590185 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard4_replica3/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard4_replica3/data;done=false>>]
[junit4] 2> 2590190 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard4_replica3/data
[junit4] 2> 2590195 T5114 oasc.SolrCore.close [awholynewcollection_0_shard3_replica3] CLOSING SolrCore org.apache.solr.core.SolrCore@7fc38e50
[junit4] 2> 2590217 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2590219 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2590219 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2590220 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2590222 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard3_replica3] Closing main searcher on request.
[junit4] 2> 2590223 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2590224 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard3_replica3/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard3_replica3/data;done=false>>]
[junit4] 2> 2590225 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard3_replica3/data
[junit4] 2> 2590226 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard3_replica3/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard3_replica3/data/index;done=false>>]
[junit4] 2> 2590227 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard3_replica3/data/index
[junit4] 2> 2590228 T5114 oasc.SolrCore.close [awholynewcollection_0_shard5_replica3] CLOSING SolrCore org.apache.solr.core.SolrCore@6234709d
[junit4] 2> 2590253 T5114 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2590254 T5114 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2590254 T5114 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2590255 T5114 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2590256 T5114 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard5_replica3] Closing main searcher on request.
[junit4] 2> 2590257 T5114 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2590258 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard5_replica3/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard5_replica3/data/index;done=false>>]
[junit4] 2> 2590259 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard5_replica3/data/index
[junit4] 2> 2590264 T5114 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard5_replica3/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard5_replica3/data;done=false>>]
[junit4] 2> 2590265 T5114 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373991687939//awholynewcollection_0_shard5_replica3/data
[junit4] 2> 2590275 T5348 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=90045918743494668-127.0.0.1:53576_dx_sd-n_0000000004) am no longer a leader.
[junit4] 2> 2590328 T5114 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/dx_sd,null}
[junit4] 2> 2590391 T5114 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> 2590397 T5114 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:53560 53560
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=B9DD77B346ADE236 -Dtests.slow=true -Dtests.locale=sr_BA -Dtests.timezone=America/Porto_Acre -Dtests.file.encoding=US-ASCII
[junit4] ERROR 95.7s | CollectionsAPIDistributedZkTest.testDistribSearch <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: collection already exists: awholynewcollection_0
[junit4] > at __randomizedtesting.SeedInfo.seed([B9DD77B346ADE236:383BF9AB31F2820A]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:424)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:264)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:318)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1522)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:438)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4] 2> 2590620 T5114 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 95761 T5113 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> 2591580 T5196 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2591580 T5196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2591581 T5196 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Lucene42: {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=sr_BA, timezone=America/Porto_Acre
[junit4] 2> NOTE: Mac OS X 10.8.4 x86_64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=2,threads=2,free=288084840,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [LeaderElectionIntegrationTest, TestUpdate, IndexSchemaTest, BadComponentTest, TestInfoStreamLogging, HardAutoCommitTest, OpenCloseCoreStressTest, ClusterStateUpdateTest, QueryResultKeyTest, AssignTest, SignatureUpdateProcessorFactoryTest, TestPhraseSuggestions, TestWordDelimiterFilterFactory, TermVectorComponentTest, TestCollationKeyRangeQueries, TestUtils, StatelessScriptUpdateProcessorFactoryTest, BasicZkTest, OutputWriterTest, TestSort, JsonLoaderTest, ShardRoutingCustomTest, TestLazyCores, SolrCoreCheckLockOnStartupTest, ZkSolrClientTest, TestNumberUtils, HdfsUnloadDistributedZkTest, AlternateDirectoryTest, SortByFunctionTest, UniqFieldsUpdateProcessorFactoryTest, SimpleFacetsTest, TestDistributedGrouping, TestOmitPositions, QueryElevationComponentTest, TestCSVResponseWriter, TestPluginEnable, ShardSplitTest, TestReplicationHandler, CSVRequestHandlerTest, TestArbitraryIndexDir, TestZkChroot, BadCopyFieldTest, HdfsBasicDistributedZk2Test, TestManagedSchemaFieldResource, TestSolrCoreProperties, SolrCoreTest, TestCodecSupport, DocumentAnalysisRequestHandlerTest, BasicDistributedZkTest, SliceStateUpdateTest, OverseerCollectionProcessorTest, TestDynamicFieldCollectionResource, TestSolrXMLSerializer, TestSchemaNameResource, TestFieldTypeCollectionResource, TestFieldCollectionResource, DisMaxRequestHandlerTest, QueryEqualityTest, LeaderElectionTest, BlockDirectoryTest, TestRTGBase, TestWriterPerf, SuggesterFSTTest, TestReloadAndDeleteDocs, SolrTestCaseJ4Test, MoreLikeThisHandlerTest, TestFuzzyAnalyzedSuggestions, FieldAnalysisRequestHandlerTest, TestSchemaSimilarityResource, DirectSolrSpellCheckerTest, SynonymTokenizerTest, DistanceFunctionTest, StatsComponentTest, TestBinaryField, ExternalFileFieldSortTest, TestLuceneMatchVersion, TestDistributedSearch, AutoCommitTest, TimeZoneUtilsTest, DistributedSpellCheckComponentTest, TestSurroundQueryParser, TestDefaultSearchFieldResource, PluginInfoTest, DocumentBuilderTest, TestStressReorder, TestStressLucene, TestUniqueKeyFieldResource, TestSolrIndexConfig, TestSolr4Spatial, LukeRequestHandlerTest, FileBasedSpellCheckerTest, HdfsSyncSliceTest, TestRandomFaceting, EchoParamsTest, TestPropInject, TestCloudManagedSchemaAddField, TestFunctionQuery, TestCSVLoader, SearchHandlerTest, SchemaVersionSpecificBehaviorTest, BasicHdfsTest, HdfsCollectionsAPIDistributedZkTest, TestCoreDiscovery, TestSchemaResource, TestPHPSerializedResponseWriter, TestRecovery, SimplePostToolTest, FieldMutatingUpdateProcessorTest, WordBreakSolrSpellCheckerTest, PathHierarchyTokenizerFactoryTest, ZkCLITest, DOMUtilTest, TestDFRSimilarityFactory, UpdateRequestProcessorFactoryTest, TestSearchPerf, TestSweetSpotSimilarityFactory, FileUtilsTest, NoCacheHeaderTest, TestDocumentBuilder, SolrCmdDistributorTest, TestFiltering, TestSolrQueryParserResource, TestTrie, TestBM25SimilarityFactory, InfoHandlerTest, TestFaceting, DefaultValueUpdateProcessorTest, BinaryUpdateRequestHandlerTest, SoftAutoCommitTest, TestSchemaVersionResource, TestMultiCoreConfBootstrap, TestIndexingPerformance, SliceStateTest, DocValuesMultiTest, TestJmxMonitoredMap, SpellPossibilityIteratorTest, TestFoldingMultitermQuery, SuggesterTSTTest, TestElisionMultitermQuery, SOLR749Test, PrimitiveFieldTypeTest, ClusterStateTest, DeleteShardTest, SolrInfoMBeanTest, TestFastLRUCache, SampleTest, PreAnalyzedFieldTest, TestStressVersions, TermsComponentTest, UUIDFieldTest, CachingDirectoryFactoryTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest]
[junit4] Completed in 97.12s, 1 test, 1 error <<< FAILURES!
[...truncated 477 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/build.xml:395: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/build.xml:375: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build.xml:181: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/common-build.xml:449: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:1250: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:893: There were test failures: 319 suites, 1345 tests, 1 error, 39 ignored (5 assumptions)
Total time: 121 minutes 4 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:+UseCompressedOops -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-MacOSX (64bit/jdk1.6.0) - Build # 636 -
Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-MacOSX/636/
Java: 64bit/jdk1.6.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
1 tests failed.
FAILED: org.apache.solr.client.solrj.TestBatchUpdate.testWithBinaryBean
Error Message:
IOException occured when talking to server at: https://127.0.0.1:55194/solr/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:55194/solr/collection1
at __randomizedtesting.SeedInfo.seed([E09EEAB4429858AB:8375EBB622FC9F89]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:435)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:168)
at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:146)
at org.apache.solr.client.solrj.TestBatchUpdate.testWithBinaryBean(TestBatchUpdate.java:92)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:680)
Caused by: org.apache.http.NoHttpResponseException: The target server failed to respond
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:95)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:62)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:254)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:289)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:252)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:191)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:300)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:127)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:717)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:522)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
... 45 more
Build Log:
[...truncated 10083 lines...]
[junit4] Suite: org.apache.solr.client.solrj.TestBatchUpdate
[junit4] 1> 70809 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.SolrJettyTestBase � Randomized ssl (true) and clientAuth (false)
[junit4] 1> 70810 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.SolrTestCaseJ4 � ####initCore
[junit4] 1> 70811 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.SolrTestCaseJ4 � ####initCore end
[junit4] 1> 70812 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.eclipse.jetty.server.Server � jetty-8.1.10.v20130312
[junit4] 1> 70897 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.eclipse.jetty.util.ssl.SslContextFactory � Enabled Protocols [SSLv2Hello, SSLv3, TLSv1] of [SSLv2Hello, SSLv3, TLSv1]
[junit4] 1> 70903 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.eclipse.jetty.server.AbstractConnector � Started SslSelectChannelConnector@127.0.0.1:55194
[junit4] 1> 70904 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.servlet.SolrDispatchFilter � SolrDispatchFilter.init()
[junit4] 1> 70905 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.core.SolrResourceLoader � JNDI not configured for solr (NoInitialContextEx)
[junit4] 1> 70906 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.core.SolrResourceLoader � using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/example/solr
[junit4] 1> 70906 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.core.SolrResourceLoader � new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/example/solr/'
[junit4] 1> 70954 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.core.ConfigSolr � Loading container configuration from /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/example/solr/solr.xml
[junit4] 1> 71056 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.core.ConfigSolrXml � Config-defined core root directory:
[junit4] 1> 71057 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.core.CoreContainer � New CoreContainer 1140087234
[junit4] 1> 71057 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.core.CoreContainer � Loading cores into CoreContainer [instanceDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/example/solr/]
[junit4] 1> 71060 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.handler.component.HttpShardHandlerFactory � Setting socketTimeout to: 0
[junit4] 1> 71060 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.handler.component.HttpShardHandlerFactory � Setting urlScheme to: http://
[junit4] 1> 71061 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.handler.component.HttpShardHandlerFactory � Setting connTimeout to: 0
[junit4] 1> 71062 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.handler.component.HttpShardHandlerFactory � Setting maxConnectionsPerHost to: 20
[junit4] 1> 71062 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.handler.component.HttpShardHandlerFactory � Setting corePoolSize to: 0
[junit4] 1> 71063 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.handler.component.HttpShardHandlerFactory � Setting maximumPoolSize to: 2147483647
[junit4] 1> 71064 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.handler.component.HttpShardHandlerFactory � Setting maxThreadIdleTime to: 5
[junit4] 1> 71064 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.handler.component.HttpShardHandlerFactory � Setting sizeOfQueue to: -1
[junit4] 1> 71065 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.handler.component.HttpShardHandlerFactory � Setting fairnessPolicy to: false
[junit4] 1> 71067 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.client.solrj.impl.HttpClientUtil � Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4] 1> 71074 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.logging.LogWatcher � Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 1> 71078 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.core.CoresLocator � Looking for core definitions underneath /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/example/solr
[junit4] 1> 71114 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.core.CoresLocator � Found core collection1 in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/example/solr/collection1/
[junit4] 1> 71116 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.core.CoresLocator � Found 1 core definitions
[junit4] 1> 71154 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.CoreContainer � Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/example/solr/collection1
[junit4] 1> 71159 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.SolrResourceLoader � new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/example/solr/collection1/'
[junit4] 1> 71256 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.SolrConfig � Adding specified lib dirs to ClassLoader
[junit4] 1> 71258 [coreLoadExecutor-72-thread-1] WARN org.apache.solr.core.SolrResourceLoader � No files added to classloader from lib: ../../../contrib/extraction/lib (resolved as: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/example/solr/collection1/../../../contrib/extraction/lib).
[junit4] 1> 71260 [coreLoadExecutor-72-thread-1] WARN org.apache.solr.core.SolrResourceLoader � Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/example/solr/collection1/../../../dist).
[junit4] 1> 71262 [coreLoadExecutor-72-thread-1] WARN org.apache.solr.core.SolrResourceLoader � No files added to classloader from lib: ../../../contrib/clustering/lib/ (resolved as: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/example/solr/collection1/../../../contrib/clustering/lib).
[junit4] 1> 71262 [coreLoadExecutor-72-thread-1] WARN org.apache.solr.core.SolrResourceLoader � Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/example/solr/collection1/../../../dist).
[junit4] 1> 71263 [coreLoadExecutor-72-thread-1] WARN org.apache.solr.core.SolrResourceLoader � No files added to classloader from lib: ../../../contrib/langid/lib/ (resolved as: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/example/solr/collection1/../../../contrib/langid/lib).
[junit4] 1> 71264 [coreLoadExecutor-72-thread-1] WARN org.apache.solr.core.SolrResourceLoader � Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/example/solr/collection1/../../../dist).
[junit4] 1> 71265 [coreLoadExecutor-72-thread-1] WARN org.apache.solr.core.SolrResourceLoader � No files added to classloader from lib: ../../../contrib/velocity/lib (resolved as: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/example/solr/collection1/../../../contrib/velocity/lib).
[junit4] 1> 71266 [coreLoadExecutor-72-thread-1] WARN org.apache.solr.core.SolrResourceLoader � Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/example/solr/collection1/../../../dist).
[junit4] 1> 71321 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.update.SolrIndexConfig � IndexWriter infoStream solr logging is enabled
[junit4] 1> 71325 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.SolrConfig � Using Lucene MatchVersion: LUCENE_43
[junit4] 1> 71427 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.Config � Loaded SolrConfig: solrconfig.xml
[junit4] 1> 71428 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.schema.IndexSchema � Reading Solr Schema from schema.xml
[junit4] 1> 71566 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.schema.IndexSchema � [collection1] Schema name=example
[junit4] 1> 72699 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.schema.IndexSchema � unique key field: id
[junit4] 1> 72740 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.schema.FileExchangeRateProvider � Reloading exchange rates from file currency.xml
[junit4] 1> 72754 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.schema.FileExchangeRateProvider � Reloading exchange rates from file currency.xml
[junit4] 1> 72849 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.SolrCore � org.apache.solr.core.MockDirectoryFactory
[junit4] 1> 72851 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.SolrCore � [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/example/solr/collection1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-solrj/test/J0/solrtest-TestBatchUpdate-1374041252468/
[junit4] 1> 72852 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.JmxMonitoredMap � JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@41955c3
[junit4] 1> 72853 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.SolrCore � [collection1] Added SolrEventListener for newSearcher: org.apache.solr.core.QuerySenderListener{queries=[]}
[junit4] 1> 72854 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.SolrCore � [collection1] Added SolrEventListener for firstSearcher: org.apache.solr.core.QuerySenderListener{queries=[{q=static firstSearcher warming in solrconfig.xml}]}
[junit4] 1> 72855 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.CachingDirectoryFactory � return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-solrj/test/J0/solrtest-TestBatchUpdate-1374041252468
[junit4] 1> 72856 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.SolrCore � New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-solrj/test/J0/solrtest-TestBatchUpdate-1374041252468/index/
[junit4] 1> 72856 [coreLoadExecutor-72-thread-1] WARN org.apache.solr.core.SolrCore � [collection1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-solrj/test/J0/solrtest-TestBatchUpdate-1374041252468/index' doesn't exist. Creating new index...
[junit4] 1> 72857 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.CachingDirectoryFactory � return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-solrj/test/J0/solrtest-TestBatchUpdate-1374041252468/index
[junit4] 1> 72860 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.SolrCore � SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1f51c9a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38d5b111),segFN=segments_1,generation=1}
[junit4] 1> 72860 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.SolrCore � newest commit generation = 1
[junit4] 1> 72862 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.SolrCore � created json: solr.JSONResponseWriter
[junit4] 1> 72862 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.SolrCore � adding lazy queryResponseWriter: solr.VelocityResponseWriter
[junit4] 1> 72863 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.SolrCore � created velocity: solr.VelocityResponseWriter
[junit4] 1> 72863 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.SolrCore � created xslt: solr.XSLTResponseWriter
[junit4] 1> 72865 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.response.XSLTResponseWriter � xsltCacheLifetimeSeconds=5
[junit4] 1> 72884 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � created /select: solr.SearchHandler
[junit4] 1> 72886 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � created /query: solr.SearchHandler
[junit4] 1> 72887 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � created /get: solr.RealTimeGetHandler
[junit4] 1> 72888 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � created /browse: solr.SearchHandler
[junit4] 1> 72889 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � created /update: solr.UpdateRequestHandler
[junit4] 1> 72890 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � created /update/json: solr.JsonUpdateRequestHandler
[junit4] 1> 72896 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � created /update/csv: solr.CSVRequestHandler
[junit4] 1> 72898 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � adding lazy requestHandler: solr.extraction.ExtractingRequestHandler
[junit4] 1> 72899 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � created /update/extract: solr.extraction.ExtractingRequestHandler
[junit4] 1> 72902 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � adding lazy requestHandler: solr.FieldAnalysisRequestHandler
[junit4] 1> 72903 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � created /analysis/field: solr.FieldAnalysisRequestHandler
[junit4] 1> 72904 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � adding lazy requestHandler: solr.DocumentAnalysisRequestHandler
[junit4] 1> 72905 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � created /analysis/document: solr.DocumentAnalysisRequestHandler
[junit4] 1> 72906 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � created /admin/: solr.admin.AdminHandlers
[junit4] 1> 72907 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � created /admin/ping: solr.PingRequestHandler
[junit4] 1> 72909 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � created /debug/dump: solr.DumpRequestHandler
[junit4] 1> 72911 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � created /replication: solr.ReplicationHandler
[junit4] 1> 72911 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � adding lazy requestHandler: solr.SearchHandler
[junit4] 1> 72912 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � created /spell: solr.SearchHandler
[junit4] 1> 72912 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � adding lazy requestHandler: solr.SearchHandler
[junit4] 1> 72913 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � created /tvrh: solr.SearchHandler
[junit4] 1> 72914 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � adding lazy requestHandler: solr.SearchHandler
[junit4] 1> 72915 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � created /terms: solr.SearchHandler
[junit4] 1> 72916 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � adding lazy requestHandler: solr.SearchHandler
[junit4] 1> 72917 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.RequestHandlers � created /elevate: solr.SearchHandler
[junit4] 1> 72925 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.handler.loader.XMLLoader � xsltCacheLifetimeSeconds=60
[junit4] 1> 72927 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.handler.loader.XMLLoader � xsltCacheLifetimeSeconds=60
[junit4] 1> 72930 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.handler.loader.XMLLoader � xsltCacheLifetimeSeconds=60
[junit4] 1> 72938 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.search.SolrIndexSearcher � Opening Searcher@7c8e3f75 main
[junit4] 1> 72943 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.SolrCore � Hard AutoCommit: if uncommited for 15000ms;
[junit4] 1> 72947 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.SolrCore � Soft AutoCommit: disabled
[junit4] 1> 72948 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.handler.component.SpellCheckComponent � Initializing spell checkers
[junit4] 1> 72949 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.spelling.DirectSolrSpellChecker � init: {name=default,field=text,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
[junit4] 1> 72949 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.handler.component.SpellCheckComponent � No queryConverter defined, using default converter
[junit4] 1> 72951 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.handler.component.QueryElevationComponent � Loading QueryElevation from: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/example/solr/collection1/conf/elevate.xml
[junit4] 1> 72981 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.handler.ReplicationHandler � Commits will be reserved for 10000
[junit4] 1> 72982 [searcherExecutor-73-thread-1] INFO org.apache.solr.core.SolrCore � QuerySenderListener sending requests to Searcher@7c8e3f75 main{StandardDirectoryReader(segments_1:1)}
[junit4] 1> 72985 [searcherExecutor-73-thread-1] INFO org.apache.solr.core.SolrCore � [collection1] webapp=null path=null params={event=firstSearcher&q=static+firstSearcher+warming+in+solrconfig.xml&distrib=false} hits=0 status=0 QTime=2
[junit4] 1> 72986 [searcherExecutor-73-thread-1] INFO org.apache.solr.core.SolrCore � QuerySenderListener done.
[junit4] 1> 72986 [searcherExecutor-73-thread-1] INFO org.apache.solr.handler.component.SpellCheckComponent � Loading spell index for spellchecker: default
[junit4] 1> 72987 [searcherExecutor-73-thread-1] INFO org.apache.solr.handler.component.SpellCheckComponent � Loading spell index for spellchecker: wordbreak
[junit4] 1> 72993 [searcherExecutor-73-thread-1] INFO org.apache.solr.core.SolrCore � [collection1] Registered new searcher Searcher@7c8e3f75 main{StandardDirectoryReader(segments_1:1)}
[junit4] 1> 73062 [coreLoadExecutor-72-thread-1] INFO org.apache.solr.core.CoreContainer � registering core: collection1
[junit4] 1> 73064 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.servlet.SolrDispatchFilter � user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-solrj/test/J0
[junit4] 1> 73065 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.servlet.SolrDispatchFilter � SolrDispatchFilter.init() done
[junit4] 1> 73065 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.SolrJettyTestBase � Jetty Assigned Port#55194
[junit4] 2> Creating dataDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-solrj/test/J0/./solrtest-TestBatchUpdate-1374041252468
[junit4] 1> 73083 [TEST-TestBatchUpdate.testWithBinaryBean-seed#[E09EEAB4429858AB]] INFO org.apache.solr.SolrTestCaseJ4 � ###Starting testWithBinaryBean
[junit4] 1> 73084 [TEST-TestBatchUpdate.testWithBinaryBean-seed#[E09EEAB4429858AB]] INFO org.apache.solr.client.solrj.impl.HttpClientUtil � Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 1> 73186 [qtp907773188-107] INFO org.apache.solr.core.SolrCore � SolrDeletionPolicy.onInit: commits: num=1
[junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1f51c9a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38d5b111),segFN=segments_1,generation=1}
[junit4] 1> 73187 [qtp907773188-107] INFO org.apache.solr.core.SolrCore � newest commit generation = 1
[junit4] 1> 73190 [qtp907773188-107] INFO org.apache.solr.search.SolrIndexSearcher � Opening Searcher@714cf72c realtime
[junit4] 1> 73191 [qtp907773188-107] INFO org.apache.solr.update.processor.LogUpdateProcessor � [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1440786682834059264)} 0 35
[junit4] 1> 74508 [qtp907773188-110] INFO org.apache.solr.update.processor.LogUpdateProcessor � [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1 (1440786682998685696), 2 (1440786683002880000), 3 (1440786683003928576), 4 (1440786683006025728), 5 (1440786683009171456), 6 (1440786683014414336), 7 (1440786683014414337), 8 (1440786683015462912), 9 (1440786683016511488), 10 (1440786683017560064), ... (1000 adds)]} 0 1170
[junit4] 1> 88192 [commitScheduler-75-thread-1] INFO org.apache.solr.update.UpdateHandler � start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 1> 88769 [commitScheduler-75-thread-1] INFO org.apache.solr.core.SolrCore � SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1f51c9a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38d5b111),segFN=segments_1,generation=1}
[junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1f51c9a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38d5b111),segFN=segments_2,generation=2}
[junit4] 1> 88771 [commitScheduler-75-thread-1] INFO org.apache.solr.core.SolrCore � newest commit generation = 2
[junit4] 1> 88774 [commitScheduler-75-thread-1] INFO org.apache.solr.search.SolrIndexSearcher � Opening Searcher@76938855 realtime
[junit4] 1> 88775 [commitScheduler-75-thread-1] INFO org.apache.solr.update.UpdateHandler � end_commit_flush
[junit4] 1> 274619 [qtp907773188-107] INFO org.apache.solr.update.UpdateHandler � start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 1> 274620 [qtp907773188-107] INFO org.apache.solr.update.UpdateHandler � No uncommitted changes. Skipping IW.commit.
[junit4] 1> 274621 [qtp907773188-107] INFO org.apache.solr.search.SolrIndexSearcher � Opening Searcher@28b48e23 main
[junit4] 1> 274623 [qtp907773188-107] INFO org.apache.solr.update.UpdateHandler � end_commit_flush
[junit4] 1> 274624 [searcherExecutor-73-thread-1] INFO org.apache.solr.core.SolrCore � QuerySenderListener sending requests to Searcher@28b48e23 main{StandardDirectoryReader(segments_2:3:nrt _0(4.5):C1000)}
[junit4] 1> 274627 [searcherExecutor-73-thread-1] INFO org.apache.solr.core.SolrCore � QuerySenderListener done.
[junit4] 1> 274627 [TEST-TestBatchUpdate.testWithBinaryBean-seed#[E09EEAB4429858AB]] INFO org.apache.solr.SolrTestCaseJ4 � ###Ending testWithBinaryBean
[junit4] 1> 274637 [searcherExecutor-73-thread-1] INFO org.apache.solr.core.SolrCore � [collection1] Registered new searcher Searcher@28b48e23 main{StandardDirectoryReader(segments_2:3:nrt _0(4.5):C1000)}
[junit4] 1> 274639 [qtp907773188-107] INFO org.apache.solr.update.processor.LogUpdateProcessor � [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 21
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestBatchUpdate -Dtests.method=testWithBinaryBean -Dtests.seed=E09EEAB4429858AB -Dtests.slow=true -Dtests.locale=sr_CS -Dtests.timezone=America/Vancouver -Dtests.file.encoding=MacRoman
[junit4] ERROR 202s | TestBatchUpdate.testWithBinaryBean <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:55194/solr/collection1
[junit4] > at __randomizedtesting.SeedInfo.seed([E09EEAB4429858AB:8375EBB622FC9F89]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:435)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] > at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4] > at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:168)
[junit4] > at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:146)
[junit4] > at org.apache.solr.client.solrj.TestBatchUpdate.testWithBinaryBean(TestBatchUpdate.java:92)
[junit4] > at java.lang.Thread.run(Thread.java:680)
[junit4] > Caused by: org.apache.http.NoHttpResponseException: The target server failed to respond
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:95)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:62)
[junit4] > at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:254)
[junit4] > at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:289)
[junit4] > at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:252)
[junit4] > at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:191)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:300)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:127)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:717)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:522)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
[junit4] > ... 45 more
[junit4] 1> 274818 [TEST-TestBatchUpdate.testWithXml-seed#[E09EEAB4429858AB]] INFO org.apache.solr.SolrTestCaseJ4 � ###Starting testWithXml
[junit4] 1> 274891 [qtp907773188-106] INFO org.apache.solr.search.SolrIndexSearcher � Opening Searcher@4128d1f4 realtime
[junit4] 1> 274892 [qtp907773188-106] INFO org.apache.solr.update.processor.LogUpdateProcessor � [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1440786894294089728)} 0 47
[junit4] 1> 275869 [qtp907773188-110] INFO org.apache.solr.update.processor.LogUpdateProcessor � [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1 (1440786894426210304), 2 (1440786894435647488), 3 (1440786894435647489), 4 (1440786894436696064), 5 (1440786894437744640), 6 (1440786894437744641), 7 (1440786894438793216), 8 (1440786894438793217), 9 (1440786894439841792), 10 (1440786894439841793), ... (1000 adds)]} 0 899
[junit4] 1> 275878 [qtp907773188-107] INFO org.apache.solr.update.UpdateHandler � start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 1> 276110 [qtp907773188-107] INFO org.apache.solr.core.SolrCore � SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1f51c9a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38d5b111),segFN=segments_2,generation=2}
[junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1f51c9a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38d5b111),segFN=segments_3,generation=3}
[junit4] 1> 276111 [qtp907773188-107] INFO org.apache.solr.core.SolrCore � newest commit generation = 3
[junit4] 1> 276160 [qtp907773188-107] INFO org.apache.solr.search.SolrIndexSearcher � Opening Searcher@7f8be298 main
[junit4] 1> 276167 [searcherExecutor-73-thread-1] INFO org.apache.solr.core.SolrCore � QuerySenderListener sending requests to Searcher@7f8be298 main{StandardDirectoryReader(segments_3:7:nrt _1(4.5):C1000)}
[junit4] 1> 276168 [searcherExecutor-73-thread-1] INFO org.apache.solr.core.SolrCore � QuerySenderListener done.
[junit4] 1> 276173 [searcherExecutor-73-thread-1] INFO org.apache.solr.core.SolrCore � [collection1] Registered new searcher Searcher@7f8be298 main{StandardDirectoryReader(segments_3:7:nrt _1(4.5):C1000)}
[junit4] 1> 276175 [qtp907773188-107] INFO org.apache.solr.update.UpdateHandler � end_commit_flush
[junit4] 1> 276176 [qtp907773188-107] INFO org.apache.solr.update.processor.LogUpdateProcessor � [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 299
[junit4] 1> 276187 [qtp907773188-106] INFO org.apache.solr.core.SolrCore � [collection1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=1000 status=0 QTime=2
[junit4] 1> 276193 [TEST-TestBatchUpdate.testWithXml-seed#[E09EEAB4429858AB]] INFO org.apache.solr.SolrTestCaseJ4 � ###Ending testWithXml
[junit4] 1> 276219 [TEST-TestBatchUpdate.testWithBinary-seed#[E09EEAB4429858AB]] INFO org.apache.solr.SolrTestCaseJ4 � ###Starting testWithBinary
[junit4] 1> 276242 [qtp907773188-109] INFO org.apache.solr.search.SolrIndexSearcher � Opening Searcher@b6e0054 realtime
[junit4] 1> 276243 [qtp907773188-109] INFO org.apache.solr.update.processor.LogUpdateProcessor � [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1440786895740076032)} 0 19
[junit4] 1> 276803 [qtp907773188-108] INFO org.apache.solr.update.processor.LogUpdateProcessor � [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1 (1440786895783067648), 2 (1440786895818719232), 3 (1440786895819767808), 4 (1440786895822913536), 5 (1440786895823962112), 6 (1440786895826059264), 7 (1440786895827107840), 8 (1440786895828156416), 9 (1440786895829204992), 10 (1440786895831302144), ... (1000 adds)]} 0 538
[junit4] 1> 276810 [qtp907773188-107] INFO org.apache.solr.update.UpdateHandler � start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 1> 276944 [qtp907773188-107] INFO org.apache.solr.core.SolrCore � SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1f51c9a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38d5b111),segFN=segments_3,generation=3}
[junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1f51c9a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38d5b111),segFN=segments_4,generation=4}
[junit4] 1> 276945 [qtp907773188-107] INFO org.apache.solr.core.SolrCore � newest commit generation = 4
[junit4] 1> 276949 [qtp907773188-107] INFO org.apache.solr.search.SolrIndexSearcher � Opening Searcher@2c808512 main
[junit4] 1> 276951 [searcherExecutor-73-thread-1] INFO org.apache.solr.core.SolrCore � QuerySenderListener sending requests to Searcher@2c808512 main{StandardDirectoryReader(segments_4:11:nrt _2(4.5):C1000)}
[junit4] 1> 276951 [searcherExecutor-73-thread-1] INFO org.apache.solr.core.SolrCore � QuerySenderListener done.
[junit4] 1> 276957 [searcherExecutor-73-thread-1] INFO org.apache.solr.core.SolrCore � [collection1] Registered new searcher Searcher@2c808512 main{StandardDirectoryReader(segments_4:11:nrt _2(4.5):C1000)}
[junit4] 1> 276965 [qtp907773188-107] INFO org.apache.solr.update.UpdateHandler � end_commit_flush
[junit4] 1> 277009 [qtp907773188-107] INFO org.apache.solr.update.processor.LogUpdateProcessor � [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 199
[junit4] 1> 277016 [qtp907773188-105] INFO org.apache.solr.core.SolrCore � [collection1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=1000 status=0 QTime=1
[junit4] 1> 277021 [TEST-TestBatchUpdate.testWithBinary-seed#[E09EEAB4429858AB]] INFO org.apache.solr.SolrTestCaseJ4 � ###Ending testWithBinary
[junit4] 1> 277046 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.core.CoreContainer � Shutting down CoreContainer instance=1140087234
[junit4] 1> 277047 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.core.SolrCore � [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@22838de0
[junit4] 1> 277111 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.update.UpdateHandler � closing DirectUpdateHandler2{commits=4,autocommit maxTime=15000ms,autocommits=1,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=3000,cumulative_deletesById=0,cumulative_deletesByQuery=3,cumulative_errors=0}
[junit4] 1> 277112 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.update.SolrCoreState � Closing SolrCoreState
[junit4] 1> 277113 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.update.DefaultSolrCoreState � SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 1> 277113 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.update.DefaultSolrCoreState � closing IndexWriter with IndexWriterCloser
[junit4] 1> 277117 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.core.SolrCore � [collection1] Closing main searcher on request.
[junit4] 1> 277118 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.core.CachingDirectoryFactory � Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 1> 277119 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.core.CachingDirectoryFactory � looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-solrj/test/J0/solrtest-TestBatchUpdate-1374041252468 [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-solrj/test/J0/solrtest-TestBatchUpdate-1374041252468;done=false>>]
[junit4] 1> 277119 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.core.CachingDirectoryFactory � Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-solrj/test/J0/solrtest-TestBatchUpdate-1374041252468
[junit4] 1> 277120 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.core.CachingDirectoryFactory � looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-solrj/test/J0/solrtest-TestBatchUpdate-1374041252468/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-solrj/test/J0/solrtest-TestBatchUpdate-1374041252468/index;done=false>>]
[junit4] 1> 277121 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.core.CachingDirectoryFactory � Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-solrj/test/J0/solrtest-TestBatchUpdate-1374041252468/index
[junit4] 1> 277121 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.eclipse.jetty.server.handler.ContextHandler � stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 1> 277178 [SUITE-TestBatchUpdate-seed#[E09EEAB4429858AB]-worker] INFO org.apache.solr.SolrTestCaseJ4 � ###deleteCore
[junit4] 2> NOTE: test params are: codec=Lucene42: {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=sr_CS, timezone=America/Vancouver
[junit4] 2> NOTE: Mac OS X 10.8.4 x86_64/Apple Inc. 1.6.0_51 (64-bit)/cpus=2,threads=1,free=50255496,total=85000192
[junit4] 2> NOTE: All tests run in this JVM: [MultiCoreExampleJettyTest, TestXMLEscaping, TestHash, QueryResponseTest, SolrPingTest, AnlysisResponseBaseTest, SolrExampleEmbeddedTest, TestDocumentObjectBinder, BasicHttpSolrServerTest, TestBatchUpdate]
[junit4] Completed in 206.43s, 3 tests, 1 error <<< FAILURES!
[...truncated 117 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/build.xml:395: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/build.xml:375: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build.xml:194: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/common-build.xml:449: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:1250: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:893: There were test failures: 46 suites, 272 tests, 1 error
Total time: 126 minutes 34 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.6.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure