You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/06/23 01:52:22 UTC
[JENKINS] Lucene-Solr-4.x-MacOSX (64bit/jdk1.7.0) - Build # 571 -
Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-MacOSX/571/
Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseG1GC
2 tests failed.
REGRESSION: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
collection already exists: awholynewcollection_0
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: collection already exists: awholynewcollection_0
at __randomizedtesting.SeedInfo.seed([A725F5B8A5E3BCDC:26C37BA0D2BCDCE0]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:424)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:264)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:313)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1455)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:438)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
shard1 is not consistent. Got 305 from http://127.0.0.1:52029/collection1lastClient and got 250 from http://127.0.0.1:52035/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:52029/collection1lastClient and got 250 from http://127.0.0.1:52035/collection1
at __randomizedtesting.SeedInfo.seed([A725F5B8A5E3BCDC:26C37BA0D2BCDCE0]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
Build Log:
[...truncated 9269 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> 31539 T18 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 31568 T18 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1371941460414
[junit4:junit4] 2> 31594 T18 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 31614 T19 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 31926 T18 oasc.ZkTestServer.run start zk server on port:52021
[junit4:junit4] 2> 32297 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 32744 T20 oazs.NIOServerCnxn.doIO WARN Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
[junit4:junit4] 2> 34323 T23 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@86ab0b2 name:ZooKeeperConnection Watcher:127.0.0.1:52021 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 34325 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 34330 T18 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 34475 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 34484 T27 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48db67e7 name:ZooKeeperConnection Watcher:127.0.0.1:52021/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 34487 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 34513 T18 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 34526 T18 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 34538 T18 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 34550 T18 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 34570 T18 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 34603 T18 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 34621 T18 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 34622 T18 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 34641 T18 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 34643 T18 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 34654 T18 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 34655 T18 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 34666 T18 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 34668 T18 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 34679 T18 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 34680 T18 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 34692 T18 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 34699 T18 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 34713 T18 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 34714 T18 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 34728 T18 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 34729 T18 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 34754 T20 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f6e155c3b0001, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2>
[junit4:junit4] 2> 36059 T18 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 36517 T18 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52025
[junit4:junit4] 2> 36597 T18 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 36600 T18 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 36601 T18 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371941463586
[junit4:junit4] 2> 36602 T18 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371941463586/solr.xml
[junit4:junit4] 2> 36603 T18 oasc.CoreContainer.<init> New CoreContainer 1030040896
[junit4:junit4] 2> 36604 T18 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371941463586/'
[junit4:junit4] 2> 36605 T18 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371941463586/'
[junit4:junit4] 2> 37025 T18 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 37026 T18 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 37027 T18 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 37028 T18 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 37029 T18 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 37030 T18 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 37032 T18 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 37039 T18 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 37040 T18 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 37125 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 38280 T18 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 38283 T18 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52021/solr
[junit4:junit4] 2> 38327 T18 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 38336 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 38347 T40 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2aeff459 name:ZooKeeperConnection Watcher:127.0.0.1:52021 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 38348 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 38362 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 38397 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 38409 T42 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3bdbd9ea name:ZooKeeperConnection Watcher:127.0.0.1:52021/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 38410 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 38430 T18 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 38457 T18 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 38499 T18 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 38507 T18 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52025_
[junit4:junit4] 2> 38517 T18 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52025_
[junit4:junit4] 2> 38534 T18 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 38577 T18 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 38591 T18 oasc.Overseer.start Overseer (id=89911555591438339-127.0.0.1:52025_-n_0000000000) starting
[junit4:junit4] 2> 38635 T18 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 38668 T44 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 38673 T18 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 38697 T18 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 38718 T18 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 38787 T43 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 38850 T45 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 38851 T45 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 40308 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 40311 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52025_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52025"}
[junit4:junit4] 2> 40312 T43 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 40351 T43 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 40387 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 40858 T45 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371941463586/collection1
[junit4:junit4] 2> 40860 T45 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 40864 T45 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 40870 T45 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 40878 T45 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371941463586/collection1/'
[junit4:junit4] 2> 40880 T45 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1371941463586/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 40881 T45 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1371941463586/collection1/lib/README' to classloader
[junit4:junit4] 2> 41042 T45 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 41183 T45 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 41188 T45 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 41363 T45 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 43142 T45 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 43146 T45 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 43150 T45 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 43265 T45 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 43284 T45 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 43410 T45 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 43426 T45 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 43446 T45 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 43451 T45 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 43452 T45 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 43452 T45 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 43456 T45 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 43457 T45 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 43458 T45 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 43503 T45 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371941463586/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371941460410/control/data/
[junit4:junit4] 2> 43509 T45 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7db78988
[junit4:junit4] 2> 43511 T45 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 43513 T45 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/control/data
[junit4:junit4] 2> 43515 T45 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371941460410/control/data/index/
[junit4:junit4] 2> 43516 T45 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371941460410/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 43518 T45 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/control/data/index
[junit4:junit4] 2> 43527 T45 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@63b9c8d4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 43528 T45 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 43610 T45 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 43614 T45 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 43616 T45 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 43624 T45 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 43626 T45 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 43626 T45 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 43627 T45 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 43629 T45 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 43630 T45 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 43661 T45 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 43683 T45 oass.SolrIndexSearcher.<init> Opening Searcher@1b1145ed main
[junit4:junit4] 2> 43700 T45 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 43701 T45 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 43807 T46 oasc.JmxMonitoredMap$SolrDynamicMBean.getMBeanInfo WARN Could not getStatistics on info bean org.apache.solr.search.SolrIndexSearcher org.apache.lucene.store.AlreadyClosedException: this IndexReader is closed
[junit4:junit4] 2> at org.apache.lucene.index.IndexReader.ensureOpen(IndexReader.java:252)
[junit4:junit4] 2> at org.apache.lucene.index.StandardDirectoryReader.getVersion(StandardDirectoryReader.java:321)
[junit4:junit4] 2> at org.apache.solr.search.SolrIndexSearcher.getStatistics(SolrIndexSearcher.java:2088)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap$SolrDynamicMBean.getMBeanInfo(JmxMonitoredMap.java:231)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:138)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:298)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1846)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.access$000(SolrCore.java:135)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1723)
[junit4:junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2>
[junit4:junit4] 2> 43815 T46 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b1145ed main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 43823 T45 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 43824 T45 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52025 collection:control_collection shard:shard1
[junit4:junit4] 2> 43840 T45 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 43879 T45 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 43929 T45 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 43955 T45 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 43956 T45 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 43961 T45 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52025/collection1/
[junit4:junit4] 2> 43962 T45 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 43962 T45 oasc.SyncStrategy.syncToMe http://127.0.0.1:52025/collection1/ has no replicas
[junit4:junit4] 2> 43963 T45 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52025/collection1/
[junit4:junit4] 2> 43964 T45 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 44949 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 44988 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 45013 T45 oasc.ZkController.register We are http://127.0.0.1:52025/collection1/ and leader is http://127.0.0.1:52025/collection1/
[junit4:junit4] 2> 45018 T45 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52025
[junit4:junit4] 2> 45019 T45 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 45019 T45 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 45021 T45 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 45026 T45 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 45035 T18 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4] 2> 45036 T18 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 45136 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 45175 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 45183 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 45195 T49 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@47ffa006 name:ZooKeeperConnection Watcher:127.0.0.1:52021/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 45196 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 45201 T18 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 45214 T18 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 45723 T18 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 45732 T18 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52029
[junit4:junit4] 2> 45733 T18 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 45734 T18 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 45735 T18 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371941474047
[junit4:junit4] 2> 45735 T18 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371941474047/solr.xml
[junit4:junit4] 2> 45736 T18 oasc.CoreContainer.<init> New CoreContainer 69139818
[junit4:junit4] 2> 45738 T18 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371941474047/'
[junit4:junit4] 2> 45738 T18 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371941474047/'
[junit4:junit4] 2> 45944 T18 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 45945 T18 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 45946 T18 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 45947 T18 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 45948 T18 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 45948 T18 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 45949 T18 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 45950 T18 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 45950 T18 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 45951 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 46009 T18 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 46016 T18 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52021/solr
[junit4:junit4] 2> 46018 T18 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 46020 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 46028 T60 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@67588300 name:ZooKeeperConnection Watcher:127.0.0.1:52021 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 46029 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 46038 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 46061 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 46067 T62 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3bc74e4e name:ZooKeeperConnection Watcher:127.0.0.1:52021/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 46067 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 46091 T18 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 46514 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 46517 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52025_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52025"}
[junit4:junit4] 2> 46533 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 46533 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 46533 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 47106 T18 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52029_
[junit4:junit4] 2> 47114 T18 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52029_
[junit4:junit4] 2> 47123 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 47126 T42 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 47126 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 47126 T49 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 47128 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 47140 T62 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 47158 T63 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 47160 T63 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 48053 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 48056 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52029_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52029"}
[junit4:junit4] 2> 48057 T43 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 48057 T43 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 48072 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 48073 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 48074 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 48166 T63 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371941474047/collection1
[junit4:junit4] 2> 48170 T63 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 48172 T63 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 48173 T63 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 48181 T63 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371941474047/collection1/'
[junit4:junit4] 2> 48183 T63 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1371941474047/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 48184 T63 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1371941474047/collection1/lib/README' to classloader
[junit4:junit4] 2> 48327 T63 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 48445 T63 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 48450 T63 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 48537 T63 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 49890 T63 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 49890 T63 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 49893 T63 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 49939 T63 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 49957 T63 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 50097 T63 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 50113 T63 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 50134 T63 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 50145 T63 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 50146 T63 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 50148 T63 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 50162 T63 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 50163 T63 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 50164 T63 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 50164 T63 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371941474047/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty1/
[junit4:junit4] 2> 50167 T63 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7db78988
[junit4:junit4] 2> 50194 T63 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 50196 T63 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty1
[junit4:junit4] 2> 50197 T63 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty1/index/
[junit4:junit4] 2> 50198 T63 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 50200 T63 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty1/index
[junit4:junit4] 2> 50220 T63 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d547f5; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 50221 T63 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 50230 T63 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 50251 T63 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 50253 T63 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 50255 T63 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 50258 T63 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 50258 T63 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 50259 T63 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 50262 T63 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 50263 T63 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 50282 T63 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 50294 T63 oass.SolrIndexSearcher.<init> Opening Searcher@6e24192b main
[junit4:junit4] 2> 50296 T63 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 50297 T63 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 50327 T64 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6e24192b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 50341 T63 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 50346 T63 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52029 collection:collection1 shard:shard1
[junit4:junit4] 2> 50350 T63 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 50379 T63 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 50392 T63 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 50393 T63 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 50394 T63 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52029/collection1/
[junit4:junit4] 2> 50395 T63 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 50395 T63 oasc.SyncStrategy.syncToMe http://127.0.0.1:52029/collection1/ has no replicas
[junit4:junit4] 2> 50396 T63 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52029/collection1/
[junit4:junit4] 2> 50397 T63 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 51109 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 51150 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 51151 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 51160 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 51210 T63 oasc.ZkController.register We are http://127.0.0.1:52029/collection1/ and leader is http://127.0.0.1:52029/collection1/
[junit4:junit4] 2> 51211 T63 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52029
[junit4:junit4] 2> 51212 T63 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 51212 T63 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 51213 T63 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 51219 T63 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 51223 T18 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4] 2> 51224 T18 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 51225 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 51729 T18 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 51744 T18 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52032
[junit4:junit4] 2> 51745 T18 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 51746 T18 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 51747 T18 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371941480089
[junit4:junit4] 2> 51747 T18 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371941480089/solr.xml
[junit4:junit4] 2> 51748 T18 oasc.CoreContainer.<init> New CoreContainer 1015496596
[junit4:junit4] 2> 51749 T18 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371941480089/'
[junit4:junit4] 2> 51750 T18 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371941480089/'
[junit4:junit4] 2> 51953 T18 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 51954 T18 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 51955 T18 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 51955 T18 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 51956 T18 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 51957 T18 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 51958 T18 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 51959 T18 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 51960 T18 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 51961 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 51984 T18 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 51985 T18 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52021/solr
[junit4:junit4] 2> 51986 T18 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 51996 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 51999 T76 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7acc53cc name:ZooKeeperConnection Watcher:127.0.0.1:52021 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 52004 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 52010 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 52033 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 52040 T78 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4260500f name:ZooKeeperConnection Watcher:127.0.0.1:52021/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 52041 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 52056 T18 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 52697 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 52700 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52029_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52029"}
[junit4:junit4] 2> 52719 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 52720 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 52721 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 52726 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 53069 T18 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52032_
[junit4:junit4] 2> 53073 T18 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52032_
[junit4:junit4] 2> 53082 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 53088 T49 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 53089 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 53090 T78 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 53092 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 53089 T42 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 53094 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 53121 T62 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 53135 T79 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 53136 T79 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 54256 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 54259 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52032_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52032"}
[junit4:junit4] 2> 54260 T43 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 54261 T43 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 54277 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 54280 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 54290 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 54291 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 55146 T79 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371941480089/collection1
[junit4:junit4] 2> 55147 T79 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 55151 T79 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 55152 T79 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 55155 T79 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371941480089/collection1/'
[junit4:junit4] 2> 55158 T79 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1371941480089/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 55158 T79 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1371941480089/collection1/lib/README' to classloader
[junit4:junit4] 2> 55350 T79 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 55483 T79 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 55488 T79 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 55545 T79 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 56809 T79 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 56811 T79 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 56814 T79 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 56840 T79 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 56846 T79 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 56911 T79 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 56936 T79 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 56953 T79 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 56957 T79 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 56958 T79 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 56959 T79 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 56963 T79 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 56964 T79 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 56964 T79 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 56966 T79 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371941480089/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty2/
[junit4:junit4] 2> 56966 T79 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7db78988
[junit4:junit4] 2> 56968 T79 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 56970 T79 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty2
[junit4:junit4] 2> 56971 T79 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty2/index/
[junit4:junit4] 2> 56972 T79 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 56973 T79 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty2/index
[junit4:junit4] 2> 56988 T79 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67d3f1cb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 56989 T79 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 56996 T79 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 56999 T79 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 57001 T79 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 57004 T79 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 57006 T79 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 57006 T79 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 57007 T79 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 57010 T79 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 57011 T79 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 57030 T79 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 57054 T79 oass.SolrIndexSearcher.<init> Opening Searcher@2a2f0af4 main
[junit4:junit4] 2> 57065 T79 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 57065 T79 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 57097 T80 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2a2f0af4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 57112 T79 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 57113 T79 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52032 collection:collection1 shard:shard1
[junit4:junit4] 2> 57125 T79 oasc.ZkController.register We are http://127.0.0.1:52032/collection1/ and leader is http://127.0.0.1:52029/collection1/
[junit4:junit4] 2> 57127 T79 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52032
[junit4:junit4] 2> 57127 T79 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 57128 T79 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C0 name=collection1 org.apache.solr.core.SolrCore@1a6b3a9a url=http://127.0.0.1:52032/collection1 node=127.0.0.1:52032_ C0_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:52032_, base_url=http://127.0.0.1:52032}
[junit4:junit4] 2> 57140 T81 C0 P52032 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 57147 T81 C0 P52032 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 57148 T81 C0 P52032 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 57148 T81 C0 P52032 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 57154 T79 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 57155 T81 C0 P52032 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 57159 T18 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4] 2> 57160 T18 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 57161 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 57355 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 57359 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52032_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52032"}
[junit4:junit4] 2> 57390 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 57391 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 57391 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 57393 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 58007 T18 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 58021 T18 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52035
[junit4:junit4] 2> 58023 T18 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 58024 T18 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 58027 T18 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371941486017
[junit4:junit4] 2> 58028 T18 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371941486017/solr.xml
[junit4:junit4] 2> 58030 T18 oasc.CoreContainer.<init> New CoreContainer 993837176
[junit4:junit4] 2> 58031 T18 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371941486017/'
[junit4:junit4] 2> 58031 T18 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371941486017/'
[junit4:junit4] 2> 58416 T18 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 58418 T18 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 58419 T18 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 58420 T18 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 58421 T18 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 58422 T18 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 58423 T18 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 58424 T18 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 58425 T18 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 58426 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 58456 T18 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 58458 T18 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52021/solr
[junit4:junit4] 2> 58458 T18 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 58461 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 58804 T93 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5ed525f name:ZooKeeperConnection Watcher:127.0.0.1:52021 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 58806 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 58834 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 58859 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 58866 T95 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3366441 name:ZooKeeperConnection Watcher:127.0.0.1:52021/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 58875 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 58991 T18 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 59439 T56 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 3, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 59440 T56 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 3, state: recovering, checkLive: true, onlyIfLeader: true for: 0 seconds.
[junit4:junit4] 2> 59442 T56 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=3&state=recovering&nodeName=127.0.0.1:52032_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=15
[junit4:junit4] 2> 60058 T18 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52035_
[junit4:junit4] 2> 60062 T18 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52035_
[junit4:junit4] 2> 60078 T78 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 60078 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 60087 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 60092 T42 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 60093 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 60094 T95 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 60094 T49 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 60097 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 60107 T62 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 60130 T96 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 60131 T96 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 60475 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 60485 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52035_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52035"}
[junit4:junit4] 2> 60487 T43 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 60488 T43 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 60505 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 60506 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 60527 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 60527 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 60527 T95 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 61138 T96 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371941486017/collection1
[junit4:junit4] 2> 61139 T96 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 61141 T96 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 61142 T96 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 61156 T96 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371941486017/collection1/'
[junit4:junit4] 2> 61158 T96 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1371941486017/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 61160 T96 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1371941486017/collection1/lib/README' to classloader
[junit4:junit4] 2> 61373 T96 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 61490 T96 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 61495 T96 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 61562 T96 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C1 name=collection1 org.apache.solr.core.SolrCore@1a6b3a9a url=http://127.0.0.1:52032/collection1 node=127.0.0.1:52032_ C1_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:52032_, base_url=http://127.0.0.1:52032}
[junit4:junit4] 2> 61639 T81 C1 P52032 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:52029/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 61652 T81 C1 P52032 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 61708 T81 C1 P52032 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:52032 START replicas=[http://127.0.0.1:52029/collection1/] nUpdates=100
[junit4:junit4] 2> ASYNC NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@1a6b3a9a url=http://127.0.0.1:52032/collection1 node=127.0.0.1:52032_ C2_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:52032_, base_url=http://127.0.0.1:52032}
[junit4:junit4] 2> 61773 T81 C2 P52032 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 61801 T81 C2 P52032 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 61802 T81 C2 P52032 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 61802 T81 C2 P52032 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 61803 T81 C2 P52032 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 61814 T81 C2 P52032 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:52029/collection1/. core=collection1
[junit4:junit4] 2> 61815 T81 C2 P52032 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C3 name=collection1 org.apache.solr.core.SolrCore@5a87c958 url=http://127.0.0.1:52029/collection1 node=127.0.0.1:52029_ C3_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52029_, base_url=http://127.0.0.1:52029, leader=true}
[junit4:junit4] 2> 61946 T58 C3 P52029 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=18
[junit4:junit4] 2> 62114 T53 C3 P52029 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 62136 T53 C3 P52029 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d547f5; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 62148 T53 C3 P52029 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 62199 T53 C3 P52029 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d547f5; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d547f5; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 62201 T53 C3 P52029 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 62203 T53 C3 P52029 oass.SolrIndexSearcher.<init> Opening Searcher@1b4c5eb6 realtime
[junit4:junit4] 2> 62208 T53 C3 P52029 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 62220 T53 C3 P52029 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 291
[junit4:junit4] 2> ASYNC NEW_CORE C4 name=collection1 org.apache.solr.core.SolrCore@1a6b3a9a url=http://127.0.0.1:52032/collection1 node=127.0.0.1:52032_ C4_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:52032_, base_url=http://127.0.0.1:52032}
[junit4:junit4] 2> 62384 T81 C4 P52032 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 62385 T81 C4 P52032 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 62413 T81 C4 P52032 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> ASYNC NEW_CORE C5 name=collection1 org.apache.solr.core.SolrCore@5a87c958 url=http://127.0.0.1:52029/collection1 node=127.0.0.1:52029_ C5_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52029_, base_url=http://127.0.0.1:52029, leader=true}
[junit4:junit4] 2> 62488 T57 C5 P52029 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 62490 T57 C5 P52029 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=73
[junit4:junit4] 2> 62492 T81 C4 P52032 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 62493 T81 C4 P52032 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 62494 T81 C4 P52032 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 62508 T56 C5 P52029 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=9
[junit4:junit4] 2> 62511 T81 C4 P52032 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 62514 T81 C4 P52032 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty2/index.20130622175131345
[junit4:junit4] 2> 62516 T81 C4 P52032 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty2/index.20130622175131345 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6766b0f5; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 62542 T58 C5 P52029 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=6
[junit4:junit4] 2> 62564 T81 C4 P52032 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 62579 T81 C4 P52032 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 62581 T81 C4 P52032 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 62596 T81 C4 P52032 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67d3f1cb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67d3f1cb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 62597 T81 C4 P52032 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 62630 T81 C4 P52032 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> ASYNC NEW_CORE C6 name=collection1 org.apache.solr.core.SolrCore@1a6b3a9a url=http://127.0.0.1:52032/collection1 node=127.0.0.1:52032_ C6_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:52032_, base_url=http://127.0.0.1:52032}
[junit4:junit4] 2> 62678 T81 C6 P52032 oass.SolrIndexSearcher.<init> Opening Searcher@373df488 main
[junit4:junit4] 2> 62693 T80 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@373df488 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 62696 T81 C6 P52032 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty2/index.20130622175131345 [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty2/index.20130622175131345;done=true>>]
[junit4:junit4] 2> 62697 T81 C6 P52032 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty2/index.20130622175131345
[junit4:junit4] 2> 62698 T81 C6 P52032 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty2/index.20130622175131345
[junit4:junit4] 2> 62736 T81 C6 P52032 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 62736 T81 C6 P52032 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 62737 T81 C6 P52032 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 62737 T81 C6 P52032 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 62745 T81 C6 P52032 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 63513 T96 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 63515 T96 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 63519 T96 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 63540 T96 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 63547 T96 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 63588 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 63591 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52032_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52032"}
[junit4:junit4] 2> 63656 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 63658 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 63658 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 63658 T95 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 63658 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 63734 T96 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 63757 T96 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 63767 T96 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 63771 T96 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 63772 T96 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 63772 T96 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 63777 T96 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 63777 T96 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 63778 T96 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 63779 T96 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371941486017/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty3/
[junit4:junit4] 2> 63779 T96 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7db78988
[junit4:junit4] 2> 63781 T96 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 63782 T96 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty3
[junit4:junit4] 2> 63783 T96 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty3/index/
[junit4:junit4] 2> 63784 T96 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 63785 T96 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty3/index
[junit4:junit4] 2> 63793 T96 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@63f98302; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 63794 T96 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 63806 T96 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 63808 T96 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 63809 T96 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 63812 T96 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 63814 T96 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 63814 T96 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 63829 T96 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 63832 T96 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 63833 T96 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 63848 T96 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 63859 T96 oass.SolrIndexSearcher.<init> Opening Searcher@360548eb main
[junit4:junit4] 2> 63867 T96 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 63867 T96 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 63885 T99 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@360548eb main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 63894 T96 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 63894 T96 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52035 collection:collection1 shard:shard1
[junit4:junit4] 2> 63905 T96 oasc.ZkController.register We are http://127.0.0.1:52035/collection1/ and leader is http://127.0.0.1:52029/collection1/
[junit4:junit4] 2> 63905 T96 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52035
[junit4:junit4] 2> 63906 T96 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 63906 T96 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C7 name=collection1 org.apache.solr.core.SolrCore@415307f8 url=http://127.0.0.1:52035/collection1 node=127.0.0.1:52035_ C7_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:52035_, base_url=http://127.0.0.1:52035}
[junit4:junit4] 2> 63908 T100 C7 P52035 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 63910 T100 C7 P52035 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 63910 T100 C7 P52035 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 63911 T100 C7 P52035 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 63913 T96 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 63914 T100 C7 P52035 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 63938 T18 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4] 2> 63939 T18 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 63940 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 63971 T57 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 64428 T18 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 64436 T18 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52043
[junit4:junit4] 2> 64438 T18 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 64439 T18 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 64439 T18 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371941492790
[junit4:junit4] 2> 64448 T18 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371941492790/solr.xml
[junit4:junit4] 2> 64448 T18 oasc.CoreContainer.<init> New CoreContainer 771495478
[junit4:junit4] 2> 64450 T18 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371941492790/'
[junit4:junit4] 2> 64450 T18 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371941492790/'
[junit4:junit4] 2> 64662 T18 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 64663 T18 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 64664 T18 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 64665 T18 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 64665 T18 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 64666 T18 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 64667 T18 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 64667 T18 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 64668 T18 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 64669 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 64707 T18 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 64709 T18 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52021/solr
[junit4:junit4] 2> 64710 T18 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 64712 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 64718 T112 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fd4eeea name:ZooKeeperConnection Watcher:127.0.0.1:52021 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 64719 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 64728 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 64754 T18 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 64766 T114 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@362ed263 name:ZooKeeperConnection Watcher:127.0.0.1:52021/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 64767 T18 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 64794 T18 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 65197 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 65200 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52035_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52035"}
[junit4:junit4] 2> 65216 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 65216 T114 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 65217 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 65218 T95 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 65219 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 65218 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 65810 T18 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52043_
[junit4:junit4] 2> 65813 T18 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52043_
[junit4:junit4] 2> 65820 T114 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 65820 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 65825 T95 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 65825 T95 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 65825 T78 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 65826 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 65825 T42 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 65832 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 65825 T49 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 65833 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 65834 T62 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 65838 T114 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 65851 T115 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 65851 T115 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 65978 T57 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 65981 T57 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:52035_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2009
[junit4:junit4] 2> 66748 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 66751 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52043_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52043"}
[junit4:junit4] 2> 66752 T43 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 66752 T43 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 66787 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 66788 T114 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 66788 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 66789 T95 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 66790 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 66793 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 66855 T115 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371941492790/collection1
[junit4:junit4] 2> 66862 T115 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 66865 T115 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 66866 T115 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 66874 T115 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371941492790/collection1/'
[junit4:junit4] 2> 66876 T115 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1371941492790/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 66877 T115 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1371941492790/collection1/lib/README' to classloader
[junit4:junit4] 2> 66988 T115 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 67086 T115 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 67091 T115 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 67116 T115 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C8 name=collection1 org.apache.solr.core.SolrCore@415307f8 url=http://127.0.0.1:52035/collection1 node=127.0.0.1:52035_ C8_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:52035_, base_url=http://127.0.0.1:52035}
[junit4:junit4] 2> 67990 T100 C8 P52035 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:52029/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 67991 T100 C8 P52035 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:52035 START replicas=[http://127.0.0.1:52029/collection1/] nUpdates=100
[junit4:junit4] 2> 67992 T100 C8 P52035 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 67993 T100 C8 P52035 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 67994 T100 C8 P52035 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 67994 T100 C8 P52035 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 67995 T100 C8 P52035 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 67996 T100 C8 P52035 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:52029/collection1/. core=collection1
[junit4:junit4] 2> 67996 T100 C8 P52035 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C9 name=collection1 org.apache.solr.core.SolrCore@5a87c958 url=http://127.0.0.1:52029/collection1 node=127.0.0.1:52029_ C9_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52029_, base_url=http://127.0.0.1:52029, leader=true}
[junit4:junit4] 2> 67997 T57 C9 P52029 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 68023 T53 C9 P52029 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 68037 T53 C9 P52029 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d547f5; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d547f5; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 68038 T53 C9 P52029 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 68039 T53 C9 P52029 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 68040 T53 C9 P52029 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 17
[junit4:junit4] 2> 68049 T100 C8 P52035 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 68051 T100 C8 P52035 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 68058 T54 C9 P52029 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 68059 T100 C8 P52035 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 68060 T100 C8 P52035 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 68060 T100 C8 P52035 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 68064 T57 C9 P52029 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=1
[junit4:junit4] 2> 68066 T100 C8 P52035 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 68092 T100 C8 P52035 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty3/index.20130622175136900
[junit4:junit4] 2> 68093 T100 C8 P52035 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty3/index.20130622175136900 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7288638b; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 68113 T56 C9 P52029 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4:junit4] 2> 68117 T100 C8 P52035 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 68122 T100 C8 P52035 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 68122 T100 C8 P52035 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 68128 T100 C8 P52035 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@63f98302; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@63f98302; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 68147 T100 C8 P52035 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 68155 T100 C8 P52035 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 68157 T100 C8 P52035 oass.SolrIndexSearcher.<init> Opening Searcher@50417024 main
[junit4:junit4] 2> 68160 T99 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@50417024 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 68162 T100 C8 P52035 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty3/index.20130622175136900 [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty3/index.20130622175136900;done=true>>]
[junit4:junit4] 2> 68163 T100 C8 P52035 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty3/index.20130622175136900
[junit4:junit4] 2> ASYNC NEW_CORE C10 name=collection1 org.apache.solr.core.SolrCore@415307f8 url=http://127.0.0.1:52035/collection1 node=127.0.0.1:52035_ C10_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:52035_, base_url=http://127.0.0.1:52035}
[junit4:junit4] 2> 68184 T100 C10 P52035 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty3/index.20130622175136900
[junit4:junit4] 2> 68186 T100 C10 P52035 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 68186 T100 C10 P52035 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 68187 T100 C10 P52035 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 68187 T100 C10 P52035 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 68197 T100 C10 P52035 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 68348 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 68351 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52035_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52035"}
[junit4:junit4] 2> 68416 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 68417 T114 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 68417 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 68418 T95 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 68419 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 68425 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 68450 T115 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 68452 T115 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 68453 T115 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 68474 T115 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 68521 T115 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 68591 T115 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 68627 T115 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 68636 T115 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 68640 T115 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 68641 T115 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 68641 T115 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 68668 T115 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 68669 T115 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 68669 T115 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 68670 T115 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371941492790/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty4/
[junit4:junit4] 2> 68670 T115 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7db78988
[junit4:junit4] 2> 68671 T115 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 68674 T115 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty4
[junit4:junit4] 2> 68675 T115 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty4/index/
[junit4:junit4] 2> 68676 T115 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 68677 T115 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty4/index
[junit4:junit4] 2> 68685 T115 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ad66992; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 68686 T115 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 68692 T115 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 68692 T115 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 68694 T115 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 68695 T115 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 68698 T115 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 68698 T115 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 68703 T115 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 68705 T115 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 68706 T115 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 68724 T115 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 68735 T115 oass.SolrIndexSearcher.<init> Opening Searcher@56e767d0 main
[junit4:junit4] 2> 68736 T115 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 68737 T115 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 68752 T118 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@56e767d0 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 68764 T115 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 68765 T115 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52043 collection:collection1 shard:shard1
[junit4:junit4] 2> 68792 T115 oasc.ZkController.register We are http://127.0.0.1:52043/collection1/ and leader is http://127.0.0.1:52029/collection1/
[junit4:junit4] 2> 68792 T115 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52043
[junit4:junit4] 2> 68793 T115 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 68794 T115 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C11 name=collection1 org.apache.solr.core.SolrCore@236b7d42 url=http://127.0.0.1:52043/collection1 node=127.0.0.1:52043_ C11_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:52043_, base_url=http://127.0.0.1:52043}
[junit4:junit4] 2> 68795 T119 C11 P52043 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 68801 T119 C11 P52043 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 68802 T119 C11 P52043 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 68802 T119 C11 P52043 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 68803 T115 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 68806 T119 C11 P52043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 68812 T18 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4] 2> 68813 T18 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 68814 T18 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 68835 T53 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 68838 T18 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 68842 T18 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 68843 T18 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 68845 T18 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 69851 T18 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 69956 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 69960 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52043_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52043"}
[junit4:junit4] 2> 69973 T114 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 69974 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 69989 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 69989 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 69989 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 69989 T95 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 70839 T53 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 70840 T53 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:52043_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2005
[junit4:junit4] 2> 70857 T18 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 71862 T18 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C11_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:52043_, base_url=http://127.0.0.1:52043}
[junit4:junit4] 2> 72843 T119 C11 P52043 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:52029/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 72844 T119 C11 P52043 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:52043 START replicas=[http://127.0.0.1:52029/collection1/] nUpdates=100
[junit4:junit4] 2> 72846 T119 C11 P52043 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 72846 T119 C11 P52043 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 72847 T119 C11 P52043 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 72847 T119 C11 P52043 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 72848 T119 C11 P52043 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 72848 T119 C11 P52043 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:52029/collection1/. core=collection1
[junit4:junit4] 2> 72849 T119 C11 P52043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C12 name=collection1 org.apache.solr.core.SolrCore@5a87c958 url=http://127.0.0.1:52029/collection1 node=127.0.0.1:52029_ C12_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52029_, base_url=http://127.0.0.1:52029, leader=true}
[junit4:junit4] 2> 72886 T55 C12 P52029 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 72891 T55 C12 P52029 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 72892 T18 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 72899 T55 C12 P52029 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d547f5; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d547f5; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d547f5; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 72900 T55 C12 P52029 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 72902 T55 C12 P52029 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 72903 T55 C12 P52029 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 13
[junit4:junit4] 2> 72905 T119 C11 P52043 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 72906 T119 C11 P52043 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 72910 T56 C12 P52029 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 72911 T119 C11 P52043 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 72912 T119 C11 P52043 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 72912 T119 C11 P52043 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 72916 T58 C12 P52029 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=1
[junit4:junit4] 2> 72917 T119 C11 P52043 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 72918 T119 C11 P52043 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty4/index.20130622175141750
[junit4:junit4] 2> 72919 T119 C11 P52043 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty4/index.20130622175141750 lockFactory=org.apache.lucene.store.NativeFSLockFactory@212bd37a; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 72924 T53 C12 P52029 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4:junit4] 2> 72927 T119 C11 P52043 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 72931 T119 C11 P52043 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 72932 T119 C11 P52043 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 72937 T119 C11 P52043 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ad66992; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ad66992; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 72938 T119 C11 P52043 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 72939 T119 C11 P52043 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 72940 T119 C11 P52043 oass.SolrIndexSearcher.<init> Opening Searcher@3291ea21 main
[junit4:junit4] 2> 72949 T118 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3291ea21 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 72951 T119 C11 P52043 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty4/index.20130622175141750 [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty4/index.20130622175141750;done=true>>]
[junit4:junit4] 2> 72952 T119 C11 P52043 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty4/index.20130622175141750
[junit4:junit4] 2> 72952 T119 C11 P52043 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty4/index.20130622175141750
[junit4:junit4] 2> 72953 T119 C11 P52043 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 72954 T119 C11 P52043 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 72954 T119 C11 P52043 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 72954 T119 C11 P52043 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 72957 T119 C11 P52043 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 73012 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 73014 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52043_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52043"}
[junit4:junit4] 2> 73027 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 73027 T114 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 73028 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 73028 T95 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 73029 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 73029 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 73906 T18 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 73914 T18 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C13 name=collection1 org.apache.solr.core.SolrCore@5f9caf98 url=http://127.0.0.1:52025/collection1 node=127.0.0.1:52025_ C13_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:52025_, base_url=http://127.0.0.1:52025, leader=true}
[junit4:junit4] 2> 73940 T38 C13 P52025 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 73948 T38 C13 P52025 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@63b9c8d4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 73948 T38 C13 P52025 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 73960 T38 C13 P52025 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@63b9c8d4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@63b9c8d4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 73961 T38 C13 P52025 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 73965 T38 C13 P52025 oass.SolrIndexSearcher.<init> Opening Searcher@43c67d6f main
[junit4:junit4] 2> 73967 T38 C13 P52025 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 73970 T46 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@43c67d6f main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 73972 T38 C13 P52025 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 32
[junit4:junit4] 2> ASYNC NEW_CORE C14 name=collection1 org.apache.solr.core.SolrCore@415307f8 url=http://127.0.0.1:52035/collection1 node=127.0.0.1:52035_ C14_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52035_, base_url=http://127.0.0.1:52035}
[junit4:junit4] 2> 74058 T89 C14 P52035 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:52029/collection1/, StdNode: http://127.0.0.1:52032/collection1/, StdNode: http://127.0.0.1:52035/collection1/, StdNode: http://127.0.0.1:52043/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 74089 T91 C14 P52035 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C15 name=collection1 org.apache.solr.core.SolrCore@5a87c958 url=http://127.0.0.1:52029/collection1 node=127.0.0.1:52029_ C15_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52029_, base_url=http://127.0.0.1:52029, leader=true}
[junit4:junit4] 2> 74090 T57 C15 P52029 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 74097 T57 C15 P52029 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d547f5; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d547f5; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d547f5; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 74098 T57 C15 P52029 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 74105 T91 C14 P52035 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@63f98302; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@63f98302; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 74106 T91 C14 P52035 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 74110 T57 C15 P52029 oass.SolrIndexSearcher.<init> Opening Searcher@32773dc2 main
[junit4:junit4] 2> 74111 T57 C15 P52029 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 74113 T91 C14 P52035 oass.SolrIndexSearcher.<init> Opening Searcher@7848213d main
[junit4:junit4] 2> 74115 T91 C14 P52035 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 74116 T64 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@32773dc2 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 74118 T57 C15 P52029 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 28
[junit4:junit4] 2> ASYNC NEW_CORE C16 name=collection1 org.apache.solr.core.SolrCore@236b7d42 url=http://127.0.0.1:52043/collection1 node=127.0.0.1:52043_ C16_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52043_, base_url=http://127.0.0.1:52043}
[junit4:junit4] 2> 74128 T109 C16 P52043 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 74129 T99 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7848213d main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 74131 T91 C14 P52035 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 43
[junit4:junit4] 2> 74137 T109 C16 P52043 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ad66992; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ad66992; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 74139 T109 C16 P52043 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> ASYNC NEW_CORE C17 name=collection1 org.apache.solr.core.SolrCore@1a6b3a9a url=http://127.0.0.1:52032/collection1 node=127.0.0.1:52032_ C17_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52032_, base_url=http://127.0.0.1:52032}
[junit4:junit4] 2> 74150 T70 C17 P52032 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 74151 T109 C16 P52043 oass.SolrIndexSearcher.<init> Opening Searcher@12e4a8b9 main
[junit4:junit4] 2> 74152 T109 C16 P52043 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 74155 T118 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@12e4a8b9 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 74159 T70 C17 P52032 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67d3f1cb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67d3f1cb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 74159 T70 C17 P52032 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 74161 T109 C16 P52043 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 33
[junit4:junit4] 2> 74164 T70 C17 P52032 oass.SolrIndexSearcher.<init> Opening Searcher@633bd33 main
[junit4:junit4] 2> 74165 T70 C17 P52032 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 74168 T80 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@633bd33 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 74170 T70 C17 P52032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 20
[junit4:junit4] 2> 74172 T89 C14 P52035 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 115
[junit4:junit4] 2> 74175 T18 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 74496 T58 C15 P52029 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=292
[junit4:junit4] 2> 74514 T71 C17 P52032 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 74537 T87 C14 P52035 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 74546 T105 C16 P52043 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C18 name=collection1 org.apache.solr.core.SolrCore@5f9caf98 url=http://127.0.0.1:52025/collection1 node=127.0.0.1:52025_ C18_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:52025_, base_url=http://127.0.0.1:52025, leader=true}
[junit4:junit4] 2> 77181 T34 C18 P52025 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438584936480112640)} 0 545
[junit4:junit4] 2> 77220 T88 C14 P52035 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1438584936629010432&update.from=http://127.0.0.1:52029/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438584936629010432)} 0 3
[junit4:junit4] 2> 77220 T107 C16 P52043 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1438584936629010432&update.from=http://127.0.0.1:52029/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438584936629010432)} 0 2
[junit4:junit4] 2> 77224 T73 C17 P52032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1438584936629010432&update.from=http://127.0.0.1:52029/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438584936629010432)} 0 3
[junit4:junit4] 2> 77225 T53 C15 P52029 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1438584936629010432)} 0 26
[junit4:junit4] 2> 77227 T106 C16 P52043 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 40
[junit4:junit4] 2> 77618 T36 C18 P52025 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0 (1438584936702410752)]} 0 378
[junit4:junit4] 2> 77670 T69 C17 P52032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52029/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438584937074655232)]} 0 22
[junit4:junit4] 2> 77671 T109 C16 P52043 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52029/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438584937074655232)]} 0 9
[junit4:junit4] 2> 77670 T91 C14 P52035 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52029/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438584937074655232)]} 0 22
[junit4:junit4] 2> 77675 T55 C15 P52029 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0 (1438584937074655232)]} 0 52
[junit4:junit4] 2> 77690 T38 C18 P52025 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1438584937133375488)]} 0 10
[junit4:junit4] 2> 77723 T70 C17 P52032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52029/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438584937154347008)]} 0 9
[junit4:junit4] 2> 77723 T89 C14 P52035 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52029/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438584937154347008)]} 0 12
[junit4:junit4] 2> 77727 T110 C16 P52043 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52029/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438584937154347008)]} 0 13
[junit4:junit4] 2> 77730 T57 C15 P52029 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1438584937154347008)]} 0 30
[junit4:junit4] 2> 77738 T33 C18 P52025 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1438584937191047168)]} 0 4
[junit4:junit4] 2> 77753 T56 C15 P52029 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:52032/collection1/]
[junit4:junit4] 2> 77753 T56 C15 P52029 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:52032/collection1/ against:[http://127.0.0.1:52032/collection1/] result:true
[junit4:junit4] 2> 77755 T56 C15 P52029 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:52035/collection1/ against:[http://127.0.0.1:52032/collection1/] result:false
[junit4:junit4] 2> 77758 T56 C15 P52029 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:52043/collection1/ against:[http://127.0.0.1:52032/collection1/] result:false
[junit4:junit4] 2> 77775 T87 C14 P52035 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52029/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:52032/collection1/&wt=javabin&version=2} {add=[2 (1438584937217261568)]} 0 5
[junit4:junit4] 2> 77781 T105 C16 P52043 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52029/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:52032/collection1/&wt=javabin&version=2} {add=[2 (1438584937217261568)]} 0 3
[junit4:junit4] 2> 77783 T56 C15 P52029 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52035/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:52032/collection1/&wt=javabin&version=2} {add=[2 (1438584937217261568)]} 0 31
[junit4:junit4] 2> 77784 T86 C14 P52035 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={test.distrib.skip.servers=http://127.0.0.1:52032/collection1/&wt=javabin&version=2} {add=[2]} 0 41
[junit4:junit4] 2> 77794 T35 C18 P52025 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1438584937249767424)]} 0 4
[junit4:junit4] 2> 77812 T58 C15 P52029 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:52032/collection1/]
[junit4:junit4] 2> 77813 T58 C15 P52029 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:52032/collection1/ against:[http://127.0.0.1:52032/collection1/] result:true
[junit4:junit4] 2> 77814 T58 C15 P52029 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:52035/collection1/ against:[http://127.0.0.1:52032/collection1/] result:false
[junit4:junit4] 2> 77814 T58 C15 P52029 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:52043/collection1/ against:[http://127.0.0.1:52032/collection1/] result:false
[junit4:junit4] 2> 77827 T106 C16 P52043 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52029/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:52032/collection1/&wt=javabin&version=2} {add=[3 (1438584937274933248)]} 0 4
[junit4:junit4] 2> 77830 T88 C14 P52035 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52029/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:52032/collection1/&wt=javabin&version=2} {add=[3 (1438584937274933248)]} 0 6
[junit4:junit4] 2> 77833 T58 C15 P52029 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52043/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:52032/collection1/&wt=javabin&version=2} {add=[3 (1438584937274933248)]} 0 22
[junit4:junit4] 2> 77835 T107 C16 P52043 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={test.distrib.skip.servers=http://127.0.0.1:52032/collection1/&test.distrib.skip.servers=http://127.0.0.1:52035/collection1/&wt=javabin&version=2} {add=[3]} 0 30
[junit4:junit4] 2> 77845 T34 C18 P52025 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C19 name=collection1 org.apache.solr.core.SolrCore@5f9caf98 url=http://127.0.0.1:52025/collection1 node=127.0.0.1:52025_ C19_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:52025_, base_url=http://127.0.0.1:52025, leader=true}
[junit4:junit4] 2> 78527 T34 C19 P52025 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@63b9c8d4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@63b9c8d4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 78528 T34 C19 P52025 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 78836 T34 C19 P52025 oass.SolrIndexSearcher.<init> Opening Searcher@4745409 main
[junit4:junit4] 2> 78843 T46 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4745409 main{StandardDirectoryReader(segments_3:3:nrt _0(4.4):c4)}
[junit4:junit4] 2> 78845 T34 C19 P52025 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 78846 T34 C19 P52025 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 1001
[junit4:junit4] 2> ASYNC NEW_CORE C20 name=collection1 org.apache.solr.core.SolrCore@415307f8 url=http://127.0.0.1:52035/collection1 node=127.0.0.1:52035_ C20_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52035_, base_url=http://127.0.0.1:52035}
[junit4:junit4] 2> 78859 T89 C20 P52035 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:52029/collection1/, StdNode: http://127.0.0.1:52032/collection1/, StdNode: http://127.0.0.1:52035/collection1/, StdNode: http://127.0.0.1:52043/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> ASYNC NEW_CORE C21 name=collection1 org.apache.solr.core.SolrCore@5a87c958 url=http://127.0.0.1:52029/collection1 node=127.0.0.1:52029_ C21_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52029_, base_url=http://127.0.0.1:52029, leader=true}
[junit4:junit4] 2> 78863 T55 C21 P52029 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 78865 T87 C20 P52035 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C22 name=collection1 org.apache.solr.core.SolrCore@236b7d42 url=http://127.0.0.1:52043/collection1 node=127.0.0.1:52043_ C22_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52043_, base_url=http://127.0.0.1:52043}
[junit4:junit4] 2> 78866 T110 C22 P52043 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C23 name=collection1 org.apache.solr.core.SolrCore@1a6b3a9a url=http://127.0.0.1:52032/collection1 node=127.0.0.1:52032_ C23_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52032_, base_url=http://127.0.0.1:52032}
[junit4:junit4] 2> 78872 T73 C23 P52032 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 79007 T110 C22 P52043 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ad66992; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ad66992; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> 79008 T110 C22 P52043 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 79024 T55 C21 P52029 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=4
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d547f5; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d547f5; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d547f5; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d547f5; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> 79028 T55 C21 P52029 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 79036 T55 C21 P52029 oass.SolrIndexSearcher.<init> Opening Searcher@42aa4965 main
[junit4:junit4] 2> 79058 T73 C23 P52032 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67d3f1cb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67d3f1cb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 79059 T73 C23 P52032 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 79087 T64 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@42aa4965 main{StandardDirectoryReader(segments_6:3:nrt _0(4.4):c4)}
[junit4:junit4] 2> 79099 T55 C21 P52029 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 79100 T55 C21 P52029 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 237
[junit4:junit4] 2> 79112 T87 C20 P52035 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@63f98302; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371941460410/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@63f98302; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 79112 T87 C20 P52035 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 79161 T87 C20 P52035 oass.SolrIndexSearcher.<init> Opening Searcher@5878bda2 main
[junit4:junit4] 2> 79167 T110 C22 P52043 oass.SolrIndexSearcher.<init> Opening Searcher@23635d06 main
[junit4:junit4] 2> 79176 T99 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5878bda2 main{StandardDirectoryReader(segments_5:3:nrt _0(4.4):c4)}
[junit4:junit4] 2> 79178 T73 C23 P52032 oass.SolrIndexSearcher.<init> Opening Searcher@703802cb main
[junit4:junit4] 2> 79181 T118 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@23635d06 main{StandardDirectoryReader(segments_6:3:nrt _0(4.4):c4)}
[junit4:junit4] 2> 79182 T80 oasc.JmxMonitoredMap.put WARN Failed to register info bean: fieldValueCache javax.management.InstanceAlreadyExistsException: solr/collection1:type=fieldValueCache,id=org.apache.solr.search.FastLRUCache
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:140)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:302)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1846)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.access$000(SolrCore.java:135)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1723)
[junit4:junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2>
[junit4:junit4] 2> 79183 T80 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@703802cb main{StandardDirectoryReader(segments_4:3:nrt _0(4.4):c2)}
[junit4:junit4] 2> 79184 T73 C23 P52032 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 79184 T73 C23 P52032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit
[...truncated too long message...]
lica1/data;done=false>>]
[junit4:junit4] 2> 861302 T1479 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1371942228661/awholynewcollection_0_shard5_replica1/data
[junit4:junit4] 2> 861303 T1479 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1371942228661/awholynewcollection_0_shard5_replica1/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1371942228661/awholynewcollection_0_shard5_replica1/data/index;done=false>>]
[junit4:junit4] 2> 861303 T1479 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1371942228661/awholynewcollection_0_shard5_replica1/data/index
[junit4:junit4] 2> 861304 T1479 oasc.SolrCore.close [awholynewcollection_0_shard1_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@7f1ecf06
[junit4:junit4] 2> 861320 T1479 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 861321 T1479 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 861322 T1479 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 861323 T1479 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 861326 T1479 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard1_replica1] Closing main searcher on request.
[junit4:junit4] 2> 861327 T1479 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 861328 T1479 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1371942228661/awholynewcollection_0_shard1_replica1/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1371942228661/awholynewcollection_0_shard1_replica1/data/index;done=false>>]
[junit4:junit4] 2> 861329 T1479 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1371942228661/awholynewcollection_0_shard1_replica1/data/index
[junit4:junit4] 2> 861329 T1479 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1371942228661/awholynewcollection_0_shard1_replica1/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1371942228661/awholynewcollection_0_shard1_replica1/data;done=false>>]
[junit4:junit4] 2> 861330 T1479 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1371942228661/awholynewcollection_0_shard1_replica1/data
[junit4:junit4] 2> 861332 T1736 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89911605420883980-127.0.0.1:52580_-n_0000000004) am no longer a leader.
[junit4:junit4] 2> 861338 T1561 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 861356 T1479 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 861431 T1479 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 861442 T1479 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:52564 52564
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=A725F5B8A5E3BCDC -Dtests.slow=true -Dtests.locale=ar_MA -Dtests.timezone=Europe/Bratislava -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR 69.1s | CollectionsAPIDistributedZkTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: collection already exists: awholynewcollection_0
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([A725F5B8A5E3BCDC:26C37BA0D2BCDCE0]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:424)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:264)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:313)
[junit4:junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1455)
[junit4:junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:438)
[junit4:junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2> 861644 T1479 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 69150 T1478 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 862640 T1561 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 862640 T1561 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {}, docValues:{}, sim=DefaultSimilarity, locale=ar_MA, timezone=Europe/Bratislava
[junit4:junit4] 2> NOTE: Mac OS X 10.8.4 x86_64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=2,threads=2,free=111416880,total=527433728
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestBadConfig, SyncSliceTest, TestSerializedLuceneMatchVersion, TestStressVersions, TestComponentsName, SpellCheckComponentTest, TestReload, BasicZkTest, MoreLikeThisHandlerTest, DefaultValueUpdateProcessorTest, TestSchemaSimilarityResource, ScriptEngineTest, SynonymTokenizerTest, TermVectorComponentDistributedTest, CircularListTest, TestSolrQueryParserResource, TestValueSourceCache, CurrencyFieldXmlFileTest, TestUtils, TestQueryUtils, TestLRUCache, SolrCoreTest, TestWriterPerf, AutoCommitTest, ConvertedLegacyTest, StatelessScriptUpdateProcessorFactoryTest, FieldAnalysisRequestHandlerTest, PingRequestHandlerTest, DateFieldTest, TestArbitraryIndexDir, TestCSVLoader, TestManagedSchema, XmlUpdateRequestHandlerTest, NotRequiredUniqueKeyTest, TestSolrQueryParser, AnalysisAfterCoreReloadTest, PreAnalyzedUpdateProcessorTest, ShardRoutingTest, ZkNodePropsTest, QueryResultKeyTest, BadIndexSchemaTest, SuggesterFSTTest, TestDefaultSimilarityFactory, OutputWriterTest, CSVRequestHandlerTest, FieldMutatingUpdateProcessorTest, TestCollationField, TestFastOutputStream, TimeZoneUtilsTest, TestStressLucene, SliceStateUpdateTest, TestPseudoReturnFields, ResponseLogComponentTest, TestSchemaResource, ZkControllerTest, ChaosMonkeySafeLeaderTest, SchemaVersionSpecificBehaviorTest, StatsComponentTest, RegexBoostProcessorTest, TestReloadAndDeleteDocs, SuggesterWFSTTest, CollectionsAPIDistributedZkTest]
[junit4:junit4] Completed in 70.25s, 1 test, 1 error <<< FAILURES!
[...truncated 727 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/build.xml:392: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/build.xml:372: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build.xml:181: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/common-build.xml:437: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:1246: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:890: There were test failures: 298 suites, 1256 tests, 1 error, 1 failure, 18 ignored (6 assumptions)
Total time: 109 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-MacOSX (64bit/jdk1.6.0) - Build # 572 -
Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-MacOSX/572/
Java: 64bit/jdk1.6.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:53176 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:53176 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([E850B3B75F2D794D:69B63DAF28721971]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:228)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:150)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:680)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
collection already exists: awholynewcollection_0
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: collection already exists: awholynewcollection_0
at __randomizedtesting.SeedInfo.seed([E850B3B75F2D794D:69B63DAF28721971]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:424)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:264)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:313)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1455)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:438)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:680)
Build Log:
[...truncated 8747 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4:junit4] 2> 1020577 T1222 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /xyro/f
[junit4:junit4] 2> 1020588 T1222 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./solrtest-CollectionsAPIDistributedZkTest-1372010989271
[junit4:junit4] 2> 1020590 T1222 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 1020591 T1223 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 1020695 T1222 oasc.ZkTestServer.run start zk server on port:52261
[junit4:junit4] 2> 1020697 T1222 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1020726 T1229 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@266c3fb2 name:ZooKeeperConnection Watcher:127.0.0.1:52261 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1020727 T1222 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1020727 T1222 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 1020739 T1222 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1020748 T1231 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d96653e name:ZooKeeperConnection Watcher:127.0.0.1:52261/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1020751 T1222 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1020752 T1222 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 1020761 T1222 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 1020768 T1222 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 1020774 T1222 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 1020782 T1222 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1020783 T1222 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1020794 T1222 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 1020795 T1222 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 1020803 T1222 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1020804 T1222 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1020814 T1222 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 1020816 T1222 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 1020826 T1222 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 1020827 T1222 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 1020836 T1222 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1020837 T1222 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1020845 T1222 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1020846 T1222 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1020855 T1222 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1020856 T1222 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1020863 T1222 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1020864 T1222 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1021425 T1222 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1021433 T1222 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52264
[junit4:junit4] 2> 1021434 T1222 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1021435 T1222 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1021436 T1222 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556
[junit4:junit4] 2> 1021436 T1222 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/solr.xml
[junit4:junit4] 2> 1021437 T1222 oasc.CoreContainer.<init> New CoreContainer 181826258
[junit4:junit4] 2> 1021438 T1222 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/'
[junit4:junit4] 2> 1021438 T1222 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/'
[junit4:junit4] 2> 1021591 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556
[junit4:junit4] 2> 1021593 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/collection1
[junit4:junit4] 2> 1021594 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/collection1/conf
[junit4:junit4] 2> 1021777 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/collection1/conf/xslt
[junit4:junit4] 2> 1021781 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/collection1/lib
[junit4:junit4] 2> 1021783 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/collection1/lib/classes
[junit4:junit4] 2> 1021785 T1222 oasc.SolrCoreDiscoverer.addCore Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/conf/core.properties, adding to cores
[junit4:junit4] 2> 1021797 T1222 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 1021797 T1222 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1021798 T1222 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 1021799 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1021799 T1222 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1021800 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1021800 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1021801 T1222 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1021802 T1222 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1021802 T1222 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 1021840 T1222 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1021841 T1222 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52261/solr
[junit4:junit4] 2> 1021842 T1222 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1021845 T1222 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1021851 T1242 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14f28f45 name:ZooKeeperConnection Watcher:127.0.0.1:52261 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1021852 T1222 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1021856 T1222 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1021890 T1222 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1021895 T1244 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@20c967a name:ZooKeeperConnection Watcher:127.0.0.1:52261/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1021895 T1222 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1021901 T1222 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 1021910 T1222 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 1021919 T1222 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1021924 T1222 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52264_xyro%2Ff
[junit4:junit4] 2> 1021926 T1222 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52264_xyro%2Ff
[junit4:junit4] 2> 1021935 T1222 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1021948 T1222 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1021959 T1222 oasc.Overseer.start Overseer (id=89916112193519619-127.0.0.1:52264_xyro%2Ff-n_0000000000) starting
[junit4:junit4] 2> 1021968 T1222 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 1021981 T1246 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1021984 T1245 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1021991 T1222 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1022000 T1222 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 1022011 T1222 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1022022 T1222 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1022023 T1222 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1022024 T1222 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1022058 T1222 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 1022061 T1222 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1022066 T1249 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53ef690a name:ZooKeeperConnection Watcher:127.0.0.1:52261/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1022066 T1222 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1022070 T1222 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1022077 T1222 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 1022548 T1222 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1022561 T1222 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52268
[junit4:junit4] 2> 1022562 T1222 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1022563 T1222 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1022563 T1222 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760
[junit4:junit4] 2> 1022564 T1222 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/solr.xml
[junit4:junit4] 2> 1022565 T1222 oasc.CoreContainer.<init> New CoreContainer 1684928197
[junit4:junit4] 2> 1022566 T1222 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/'
[junit4:junit4] 2> 1022566 T1222 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/'
[junit4:junit4] 2> 1022755 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760
[junit4:junit4] 2> 1022757 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/collection1
[junit4:junit4] 2> 1022759 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/collection1/conf
[junit4:junit4] 2> 1022910 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/collection1/conf/xslt
[junit4:junit4] 2> 1022915 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/collection1/lib
[junit4:junit4] 2> 1022916 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/collection1/lib/classes
[junit4:junit4] 2> 1022919 T1222 oasc.SolrCoreDiscoverer.addCore Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/conf/core.properties, adding to cores
[junit4:junit4] 2> 1022930 T1222 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 1022931 T1222 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1022932 T1222 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 1022932 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1022933 T1222 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1022933 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1022934 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1022935 T1222 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1022935 T1222 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1022936 T1222 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 1022976 T1222 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1022977 T1222 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52261/solr
[junit4:junit4] 2> 1022982 T1222 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1022995 T1222 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1023001 T1260 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6af4992d name:ZooKeeperConnection Watcher:127.0.0.1:52261 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1023002 T1222 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1023007 T1222 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1023043 T1222 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1023055 T1262 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5a77564a name:ZooKeeperConnection Watcher:127.0.0.1:52261/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1023056 T1222 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1023069 T1222 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1024082 T1222 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52268_xyro%2Ff
[junit4:junit4] 2> 1024085 T1222 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52268_xyro%2Ff
[junit4:junit4] 2> 1024102 T1249 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1024103 T1262 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1024126 T1222 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1024127 T1222 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1024130 T1222 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1024139 T1244 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1024701 T1222 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1024708 T1222 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52271
[junit4:junit4] 2> 1024711 T1222 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1024712 T1222 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1024712 T1222 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849
[junit4:junit4] 2> 1024713 T1222 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/solr.xml
[junit4:junit4] 2> 1024714 T1222 oasc.CoreContainer.<init> New CoreContainer 985620654
[junit4:junit4] 2> 1024715 T1222 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/'
[junit4:junit4] 2> 1024715 T1222 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/'
[junit4:junit4] 2> 1024913 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849
[junit4:junit4] 2> 1024915 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/collection1
[junit4:junit4] 2> 1024916 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/collection1/conf
[junit4:junit4] 2> 1025077 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/collection1/conf/xslt
[junit4:junit4] 2> 1025081 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/collection1/lib
[junit4:junit4] 2> 1025083 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/collection1/lib/classes
[junit4:junit4] 2> 1025085 T1222 oasc.SolrCoreDiscoverer.addCore Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/conf/core.properties, adding to cores
[junit4:junit4] 2> 1025097 T1222 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 1025098 T1222 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1025099 T1222 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 1025099 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1025100 T1222 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1025101 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1025101 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1025102 T1222 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1025102 T1222 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1025103 T1222 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 1025136 T1222 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1025142 T1222 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52261/solr
[junit4:junit4] 2> 1025145 T1222 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1025147 T1222 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1025152 T1274 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7be5f734 name:ZooKeeperConnection Watcher:127.0.0.1:52261 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1025153 T1222 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1025158 T1222 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1025190 T1222 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1025195 T1276 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d4d8ebc name:ZooKeeperConnection Watcher:127.0.0.1:52261/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1025195 T1222 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1025207 T1222 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1026224 T1222 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52271_xyro%2Ff
[junit4:junit4] 2> 1026227 T1222 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52271_xyro%2Ff
[junit4:junit4] 2> 1026240 T1244 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1026241 T1249 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1026241 T1262 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1026253 T1222 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1026258 T1222 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1026259 T1222 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1026258 T1276 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1026796 T1222 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1026807 T1222 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52274
[junit4:junit4] 2> 1026808 T1222 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1026809 T1222 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1026810 T1222 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1372010994977
[junit4:junit4] 2> 1026810 T1222 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1372010994977/solr.xml
[junit4:junit4] 2> 1026811 T1222 oasc.CoreContainer.<init> New CoreContainer 1048882801
[junit4:junit4] 2> 1026812 T1222 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1372010994977/'
[junit4:junit4] 2> 1026812 T1222 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1372010994977/'
[junit4:junit4] 2> 1027022 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1372010994977
[junit4:junit4] 2> 1027024 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1372010994977/collection1
[junit4:junit4] 2> 1027025 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1372010994977/collection1/conf
[junit4:junit4] 2> 1027171 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1372010994977/collection1/conf/xslt
[junit4:junit4] 2> 1027180 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1372010994977/collection1/lib
[junit4:junit4] 2> 1027182 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1372010994977/collection1/lib/classes
[junit4:junit4] 2> 1027184 T1222 oasc.SolrCoreDiscoverer.addCore Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1372010994977/conf/core.properties, adding to cores
[junit4:junit4] 2> 1027199 T1222 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 1027200 T1222 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1027200 T1222 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 1027201 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1027201 T1222 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1027202 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1027203 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1027203 T1222 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1027204 T1222 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1027205 T1222 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 1027237 T1222 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1027238 T1222 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52261/solr
[junit4:junit4] 2> 1027238 T1222 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1027245 T1222 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1027252 T1288 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6837725 name:ZooKeeperConnection Watcher:127.0.0.1:52261 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1027253 T1222 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1027259 T1222 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1027289 T1222 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1027295 T1290 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@417a2ff0 name:ZooKeeperConnection Watcher:127.0.0.1:52261/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1027295 T1222 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1027308 T1222 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1028322 T1222 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52274_xyro%2Ff
[junit4:junit4] 2> 1028325 T1222 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52274_xyro%2Ff
[junit4:junit4] 2> 1028338 T1290 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1028339 T1262 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1028339 T1244 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1028364 T1276 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1028364 T1249 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1028365 T1222 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1028371 T1222 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1028373 T1222 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1028859 T1222 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1028865 T1222 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52277
[junit4:junit4] 2> 1028868 T1222 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1028869 T1222 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1028870 T1222 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083
[junit4:junit4] 2> 1028870 T1222 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/solr.xml
[junit4:junit4] 2> 1028871 T1222 oasc.CoreContainer.<init> New CoreContainer 1225447518
[junit4:junit4] 2> 1028872 T1222 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/'
[junit4:junit4] 2> 1028872 T1222 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/'
[junit4:junit4] 2> 1029064 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083
[junit4:junit4] 2> 1029065 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/collection1
[junit4:junit4] 2> 1029067 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/collection1/conf
[junit4:junit4] 2> 1029209 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/collection1/conf/xslt
[junit4:junit4] 2> 1029214 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/collection1/lib
[junit4:junit4] 2> 1029215 T1222 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/collection1/lib/classes
[junit4:junit4] 2> 1029218 T1222 oasc.SolrCoreDiscoverer.addCore Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/conf/core.properties, adding to cores
[junit4:junit4] 2> 1029230 T1222 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 1029230 T1222 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1029231 T1222 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 1029231 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1029232 T1222 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1029233 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1029237 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1029239 T1222 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1029239 T1222 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1029240 T1222 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 1029274 T1222 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1029276 T1222 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52261/solr
[junit4:junit4] 2> 1029276 T1222 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1029280 T1222 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1029667 T1302 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36eb5e1f name:ZooKeeperConnection Watcher:127.0.0.1:52261 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1029671 T1222 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1029694 T1222 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1029743 T1222 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1029754 T1304 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a3b7fdd name:ZooKeeperConnection Watcher:127.0.0.1:52261/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1029755 T1222 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1029784 T1222 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1030807 T1222 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52277_xyro%2Ff
[junit4:junit4] 2> 1030964 T1222 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52277_xyro%2Ff
[junit4:junit4] 2> 1030978 T1262 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1030978 T1290 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1030979 T1304 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1030994 T1276 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1030996 T1249 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1030996 T1244 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1030996 T1222 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1030997 T1222 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1030998 T1222 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1031032 T1222 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1031072 T1256 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4:junit4] 2> 1031076 T1244 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 1031079 T1246 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4:junit4] 2> "operation":"createcollection",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "maxShardsPerNode":null,
[junit4:junit4] 2> "createNodeSet":null,
[junit4:junit4] 2> "name":"nodes_used_collection",
[junit4:junit4] 2> "replicationFactor":"2"}
[junit4:junit4] 2> 1031079 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica1 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:52271_xyro%2Ff
[junit4:junit4] 2> 1031080 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica2 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:52264_xyro%2Ff
[junit4:junit4] 2> 1031081 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica1 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:52268_xyro%2Ff
[junit4:junit4] 2> 1031086 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica2 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:52277_xyro%2Ff
[junit4:junit4] 2> 1031095 T1257 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=down
[junit4:junit4] 2> 1031105 T1299 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=down
[junit4:junit4] 2> 1031110 T1269 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=down
[junit4:junit4] 2> 1031113 T1240 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=down
[junit4:junit4] 2> 1031192 T1245 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1031193 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52268_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52268/xyro/f"}
[junit4:junit4] 2> 1031194 T1245 oasc.Overseer$ClusterStateUpdater.createCollection Create collection nodes_used_collection with numShards 2
[junit4:junit4] 2> 1031211 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52277_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52277/xyro/f"}
[junit4:junit4] 2> 1031222 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52271_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52271/xyro/f"}
[junit4:junit4] 2> 1031234 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52264_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52264/xyro/f"}
[junit4:junit4] 2> 1031247 T1244 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1031248 T1249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1031249 T1290 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1031249 T1304 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1031250 T1262 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1031254 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1032118 T1299 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 1032119 T1299 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 1032118 T1257 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 1032122 T1257 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 1032122 T1269 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/nodes_used_collection_shard1_replica1
[junit4:junit4] 2> 1032124 T1269 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 1032122 T1240 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 1032125 T1240 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 1032124 T1299 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 1032126 T1299 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 1032126 T1257 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 1032127 T1257 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 1032129 T1269 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 1032130 T1269 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 1032130 T1240 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 1032131 T1240 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 1032134 T1299 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 1032134 T1257 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 1032135 T1257 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 1032136 T1299 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 1032137 T1240 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 1032137 T1269 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 1032139 T1240 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 1032139 T1269 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 1032146 T1257 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 1032152 T1240 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 1032156 T1269 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 1032160 T1257 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/nodes_used_collection_shard2_replica1/'
[junit4:junit4] 2> 1032165 T1240 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/nodes_used_collection_shard1_replica2/'
[junit4:junit4] 2> 1032179 T1299 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 1032179 T1269 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/nodes_used_collection_shard1_replica1/'
[junit4:junit4] 2> 1032187 T1299 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/nodes_used_collection_shard2_replica2/'
[junit4:junit4] 2> 1032524 T1257 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1032531 T1269 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1032542 T1240 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1032614 T1299 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1032893 T1257 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1032902 T1257 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1032912 T1240 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1032915 T1269 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1032926 T1257 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica1] Schema name=test
[junit4:junit4] 2> 1032937 T1240 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1032941 T1269 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1033006 T1269 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica1] Schema name=test
[junit4:junit4] 2> 1033031 T1299 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1033032 T1240 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica2] Schema name=test
[junit4:junit4] 2> 1033106 T1299 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1033139 T1299 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica2] Schema name=test
[junit4:junit4] 2> 1036511 T1299 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 1036511 T1299 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 1036513 T1299 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1036581 T1299 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1036585 T1299 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1036790 T1240 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 1036826 T1240 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 1036828 T1240 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1036852 T1240 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1036854 T1257 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 1036864 T1257 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 1036866 T1257 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1036870 T1240 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1036932 T1299 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1036950 T1299 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1036960 T1299 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1036961 T1257 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1036966 T1299 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1036967 T1299 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1036967 T1299 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1036975 T1257 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1036976 T1299 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1036991 T1299 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1036991 T1299 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1036994 T1269 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 1036995 T1269 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 1036996 T1269 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1037003 T1299 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica2] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/nodes_used_collection_shard2_replica2/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/nodes_used_collection_shard2_replica2/data/
[junit4:junit4] 2> 1037004 T1299 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@625db9eb
[junit4:junit4] 2> 1037044 T1269 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1037046 T1299 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1037055 T1299 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/nodes_used_collection_shard2_replica2/data
[junit4:junit4] 2> 1037056 T1299 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/nodes_used_collection_shard2_replica2/data/index/
[junit4:junit4] 2> 1037057 T1299 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica2] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/nodes_used_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1037058 T1299 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/nodes_used_collection_shard2_replica2/data/index
[junit4:junit4] 2> 1037067 T1269 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1037075 T1299 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4efb8be6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@72501d2c),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1037077 T1299 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1037093 T1299 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1037097 T1299 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1037099 T1299 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1037104 T1299 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1037105 T1299 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1037106 T1299 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1037106 T1299 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1037108 T1299 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1037109 T1299 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1037110 T1240 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1037131 T1299 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1037144 T1257 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1037148 T1240 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1037155 T1299 oass.SolrIndexSearcher.<init> Opening Searcher@744a0284 main
[junit4:junit4] 2> 1037156 T1299 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/nodes_used_collection_shard2_replica2/data/tlog
[junit4:junit4] 2> 1037158 T1299 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1037158 T1299 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1037164 T1310 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica2] Registered new searcher Searcher@744a0284 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1037156 T1257 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1037178 T1240 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1037186 T1257 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1037187 T1240 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1037187 T1240 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1037188 T1240 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1037195 T1257 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1037197 T1257 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1037197 T1257 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1037196 T1299 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 1037199 T1299 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica2 address:http://127.0.0.1:52277/xyro/f collection:nodes_used_collection shard:shard2
[junit4:junit4] 2> 1037196 T1240 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1037201 T1240 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1037201 T1240 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1037202 T1299 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard2/election
[junit4:junit4] 2> 1037202 T1240 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica2] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/nodes_used_collection_shard1_replica2/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/nodes_used_collection_shard1_replica2/data/
[junit4:junit4] 2> 1037205 T1240 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@625db9eb
[junit4:junit4] 2> 1037206 T1240 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1037208 T1257 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1037209 T1257 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1037210 T1257 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1037210 T1257 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/nodes_used_collection_shard2_replica1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/nodes_used_collection_shard2_replica1/data/
[junit4:junit4] 2> 1037211 T1257 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@625db9eb
[junit4:junit4] 2> 1037212 T1257 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1037209 T1240 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/nodes_used_collection_shard1_replica2/data
[junit4:junit4] 2> 1037213 T1240 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/nodes_used_collection_shard1_replica2/data/index/
[junit4:junit4] 2> 1037214 T1240 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica2] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/nodes_used_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1037214 T1257 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/nodes_used_collection_shard2_replica1/data
[junit4:junit4] 2> 1037215 T1257 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/nodes_used_collection_shard2_replica1/data/index/
[junit4:junit4] 2> 1037217 T1257 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/nodes_used_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1037218 T1257 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/nodes_used_collection_shard2_replica1/data/index
[junit4:junit4] 2> 1037215 T1240 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/nodes_used_collection_shard1_replica2/data/index
[junit4:junit4] 2> 1037232 T1257 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@47110aea lockFactory=org.apache.lucene.store.NativeFSLockFactory@73c03ade),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1037234 T1257 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1037234 T1240 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ffe5c31 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3805a05b),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1037235 T1240 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1037251 T1257 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1037252 T1257 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1037255 T1269 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1037257 T1257 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1037254 T1240 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1037261 T1240 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1037262 T1240 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1037264 T1240 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1037264 T1257 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1037266 T1257 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1037267 T1257 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1037268 T1257 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1037265 T1240 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1037269 T1240 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1037269 T1240 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1037271 T1240 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1037272 T1240 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1037327 T1257 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1037328 T1257 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1037329 T1299 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1037329 T1269 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1037337 T1257 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1037340 T1240 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1037351 T1257 oass.SolrIndexSearcher.<init> Opening Searcher@7c457504 main
[junit4:junit4] 2> 1037353 T1257 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/nodes_used_collection_shard2_replica1/data/tlog
[junit4:junit4] 2> 1037355 T1257 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1037356 T1269 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1037356 T1299 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=179995
[junit4:junit4] 2> 1037356 T1257 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1037372 T1311 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica1] Registered new searcher Searcher@7c457504 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1037373 T1240 oass.SolrIndexSearcher.<init> Opening Searcher@8b86142 main
[junit4:junit4] 2> 1037374 T1240 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/nodes_used_collection_shard1_replica2/data/tlog
[junit4:junit4] 2> 1037377 T1240 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1037378 T1240 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1037383 T1269 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1037384 T1269 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1037384 T1269 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1037390 T1257 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 1037392 T1257 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica1 address:http://127.0.0.1:52268/xyro/f collection:nodes_used_collection shard:shard2
[junit4:junit4] 2> 1037391 T1312 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica2] Registered new searcher Searcher@8b86142 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1037395 T1269 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1037396 T1269 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1037396 T1269 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1037397 T1269 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/nodes_used_collection_shard1_replica1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/nodes_used_collection_shard1_replica1/data/
[junit4:junit4] 2> 1037400 T1269 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@625db9eb
[junit4:junit4] 2> 1037401 T1240 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 1037402 T1240 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica2 address:http://127.0.0.1:52264/xyro/f collection:nodes_used_collection shard:shard1
[junit4:junit4] 2> 1037401 T1269 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1037404 T1269 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/nodes_used_collection_shard1_replica1/data
[junit4:junit4] 2> 1037404 T1269 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/nodes_used_collection_shard1_replica1/data/index/
[junit4:junit4] 2> 1037405 T1269 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/nodes_used_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1037406 T1269 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/nodes_used_collection_shard1_replica1/data/index
[junit4:junit4] 2> 1037414 T1240 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1037418 T1269 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7e1e7fda lockFactory=org.apache.lucene.store.NativeFSLockFactory@69e2b197),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1037419 T1269 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1037427 T1245 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1037440 T1269 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1037441 T1269 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1037443 T1269 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1037446 T1269 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1037448 T1269 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1037449 T1269 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1037453 T1269 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1037454 T1269 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1037456 T1269 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1037458 T1249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1037459 T1290 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1037460 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1037460 T1244 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1037461 T1304 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1037462 T1262 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1037480 T1269 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1037495 T1269 oass.SolrIndexSearcher.<init> Opening Searcher@49ad9817 main
[junit4:junit4] 2> 1037496 T1269 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/nodes_used_collection_shard1_replica1/data/tlog
[junit4:junit4] 2> 1037500 T1269 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1037500 T1269 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1037506 T1313 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica1] Registered new searcher Searcher@49ad9817 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1037509 T1240 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1037515 T1269 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica1
[junit4:junit4] 2> 1037516 T1269 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica1 address:http://127.0.0.1:52271/xyro/f collection:nodes_used_collection shard:shard1
[junit4:junit4] 2> 1037533 T1240 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1037535 T1240 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1037536 T1240 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52264/xyro/f/nodes_used_collection_shard1_replica2/
[junit4:junit4] 2> 1037536 T1240 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica2 url=http://127.0.0.1:52264/xyro/f START replicas=[http://127.0.0.1:52271/xyro/f/nodes_used_collection_shard1_replica1/] nUpdates=100
[junit4:junit4] 2> 1037550 T1240 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica2 url=http://127.0.0.1:52264/xyro/f DONE. We have no versions. sync failed.
[junit4:junit4] 2> 1037555 T1240 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 1037555 T1240 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 1037559 T1240 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52264/xyro/f/nodes_used_collection_shard1_replica2/
[junit4:junit4] 2> 1037560 T1240 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard1
[junit4:junit4] 2> ASYNC NEW_CORE C6614 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore@54514d60 url=http://127.0.0.1:52271/xyro/f/nodes_used_collection_shard1_replica1 node=127.0.0.1:52271_xyro%2Ff C6614_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{shard=shard1, state=down, core=nodes_used_collection_shard1_replica1, collection=nodes_used_collection, node_name=127.0.0.1:52271_xyro%2Ff, base_url=http://127.0.0.1:52271/xyro/f}
[junit4:junit4] 2> 1037566 T1267 C6614 P52271 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/xyro/f path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 1037871 T1299 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1037871 T1299 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1037872 T1299 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52277/xyro/f/nodes_used_collection_shard2_replica2/
[junit4:junit4] 2> 1037872 T1299 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:52277/xyro/f START replicas=[http://127.0.0.1:52268/xyro/f/nodes_used_collection_shard2_replica1/] nUpdates=100
[junit4:junit4] 2> 1037878 T1299 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:52277/xyro/f DONE. We have no versions. sync failed.
[junit4:junit4] 2> 1037879 T1299 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 1037891 T1299 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 1037892 T1299 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52277/xyro/f/nodes_used_collection_shard2_replica2/
[junit4:junit4] 2> ASYNC NEW_CORE C6615 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@1d325ad2 url=http://127.0.0.1:52268/xyro/f/nodes_used_collection_shard2_replica1 node=127.0.0.1:52268_xyro%2Ff C6615_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=down, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:52268_xyro%2Ff, base_url=http://127.0.0.1:52268/xyro/f}
[junit4:junit4] 2> 1037892 T1258 C6615 P52268 oasc.SolrCore.execute [nodes_used_collection_shard2_replica1] webapp=/xyro/f path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=4
[junit4:junit4] 2> 1037898 T1299 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard2
[junit4:junit4] 2> 1039002 T1245 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1039108 T1249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1039108 T1290 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1039109 T1304 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1039110 T1262 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1039111 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1039109 T1244 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1039135 T1299 oasc.ZkController.register We are http://127.0.0.1:52277/xyro/f/nodes_used_collection_shard2_replica2/ and leader is http://127.0.0.1:52277/xyro/f/nodes_used_collection_shard2_replica2/
[junit4:junit4] 2> 1039136 T1299 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica2 baseURL=http://127.0.0.1:52277/xyro/f
[junit4:junit4] 2> 1039136 T1299 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1039137 T1299 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=active
[junit4:junit4] 2> 1039147 T1299 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1039150 T1257 oasc.ZkController.register We are http://127.0.0.1:52268/xyro/f/nodes_used_collection_shard2_replica1/ and leader is http://127.0.0.1:52277/xyro/f/nodes_used_collection_shard2_replica2/
[junit4:junit4] 2> 1039151 T1257 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica1 baseURL=http://127.0.0.1:52268/xyro/f
[junit4:junit4] 2> 1039151 T1257 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 1039152 T1257 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> 1039153 T1299 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=8048
[junit4:junit4] 2> 1039164 T1316 C6615 P52268 oasc.RecoveryStrategy.run Starting recovery process. core=nodes_used_collection_shard2_replica1 recoveringAfterStartup=true
[junit4:junit4] 2> 1039169 T1316 C6615 P52268 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1039169 T1269 oasc.ZkController.register We are http://127.0.0.1:52271/xyro/f/nodes_used_collection_shard1_replica1/ and leader is http://127.0.0.1:52264/xyro/f/nodes_used_collection_shard1_replica2/
[junit4:junit4] 2> 1039172 T1316 C6615 P52268 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=recovering
[junit4:junit4] 2> 1039175 T1257 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1039175 T1269 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica1 baseURL=http://127.0.0.1:52271/xyro/f
[junit4:junit4] 2> 1039177 T1269 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard1_replica1
[junit4:junit4] 2> 1039177 T1269 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> 1039183 T1316 C6615 P52268 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C6616 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore@54514d60 url=http://127.0.0.1:52271/xyro/f/nodes_used_collection_shard1_replica1 node=127.0.0.1:52271_xyro%2Ff C6616_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{shard=shard1, state=down, core=nodes_used_collection_shard1_replica1, collection=nodes_used_collection, node_name=127.0.0.1:52271_xyro%2Ff, base_url=http://127.0.0.1:52271/xyro/f}
[junit4:junit4] 2> 1039189 T1317 C6616 P52271 oasc.RecoveryStrategy.run Starting recovery process. core=nodes_used_collection_shard1_replica1 recoveringAfterStartup=true
[junit4:junit4] 2> 1039190 T1317 C6616 P52271 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1039193 T1317 C6616 P52271 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=recovering
[junit4:junit4] 2> 1039202 T1257 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=8107
[junit4:junit4] 2> 1039203 T1269 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1039212 T1317 C6616 P52271 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1039211 T1240 oasc.ZkController.register We are http://127.0.0.1:52264/xyro/f/nodes_used_collection_shard1_replica2/ and leader is http://127.0.0.1:52264/xyro/f/nodes_used_collection_shard1_replica2/
[junit4:junit4] 2> 1039214 T1240 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica2 baseURL=http://127.0.0.1:52264/xyro/f
[junit4:junit4] 2> 1039215 T1240 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1039215 T1240 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=active
[junit4:junit4] 2> 1039224 T1269 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=8114
[junit4:junit4] 2> 1039263 T1240 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1039274 T1300 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:52268_xyro%2Ff_nodes_used_collection_shard2_replica1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1039294 T1238 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:52271_xyro%2Ff_nodes_used_collection_shard1_replica1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1039296 T1240 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=8183
[junit4:junit4] 2> 1039297 T1246 oasc.OverseerCollectionProcessor.createCollection Finished create command on all shards for collection: nodes_used_collection
[junit4:junit4] 2> 1039321 T1262 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work/qnr-0000000000 state: SyncConnected type NodeDataChanged
[junit4:junit4] 2> 1039330 T1244 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 1039331 T1246 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000000 complete, response:{success={null={responseHeader={status=0,QTime=8048},core=nodes_used_collection_shard2_replica2},null={responseHeader={status=0,QTime=8107},core=nodes_used_collection_shard2_replica1},null={responseHeader={status=0,QTime=8114},core=nodes_used_collection_shard1_replica1},null={responseHeader={status=0,QTime=8183},core=nodes_used_collection_shard1_replica2}}}
[junit4:junit4] 2> 1039333 T1256 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2} status=0 QTime=8261
[junit4:junit4] 2> 1039335 T1222 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 1039343 T1222 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1039350 T1319 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55f275d name:ZooKeeperConnection Watcher:127.0.0.1:52261/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1039351 T1222 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1039363 T1222 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1039378 T1222 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 1039383 T1222 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1039396 T1321 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43e6d03d name:ZooKeeperConnection Watcher:127.0.0.1:52261/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1039397 T1222 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1039412 T1222 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1039463 T1281 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=4&maxShardsPerNode=5&name=awholynewcollection_0&replicationFactor=5&action=CREATE&wt=javabin&version=2
[junit4:junit4] 2> 1039473 T1244 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 1039486 T1246 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000002 message:{
[junit4:junit4] 2> "operation":"createcollection",
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "maxShardsPerNode":"5",
[junit4:junit4] 2> "createNodeSet":null,
[junit4:junit4] 2> "name":"awholynewcollection_0",
[junit4:junit4] 2> "replicationFactor":"5"}
[junit4:junit4] 2> 1039486 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica1 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:52264_xyro%2Ff
[junit4:junit4] 2> 1039487 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica2 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:52277_xyro%2Ff
[junit4:junit4] 2> 1039487 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica3 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:52271_xyro%2Ff
[junit4:junit4] 2> 1039487 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica4 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:52274_xyro%2Ff
[junit4:junit4] 2> 1039488 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica5 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:52268_xyro%2Ff
[junit4:junit4] 2> 1039496 T1295 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica2 state=down
[junit4:junit4] 2> 1039499 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica1 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:52264_xyro%2Ff
[junit4:junit4] 2> 1039502 T1282 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica4 state=down
[junit4:junit4] 2> 1039511 T1239 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica1 state=down
[junit4:junit4] 2> 1039518 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica2 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:52277_xyro%2Ff
[junit4:junit4] 2> 1039519 T1268 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica3 state=down
[junit4:junit4] 2> 1039519 T1258 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica5 state=down
[junit4:junit4] 2> 1039526 T1235 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica1 state=down
[junit4:junit4] 2> 1039536 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica3 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:52271_xyro%2Ff
[junit4:junit4] 2> 1039544 T1296 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica2 state=down
[junit4:junit4] 2> 1039547 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica4 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:52274_xyro%2Ff
[junit4:junit4] 2> 1039556 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica5 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:52268_xyro%2Ff
[junit4:junit4] 2> 1039556 T1270 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica3 state=down
[junit4:junit4] 2> 1039561 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica1 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:52264_xyro%2Ff
[junit4:junit4] 2> 1039568 T1254 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica5 state=down
[junit4:junit4] 2> 1039564 T1283 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica4 state=down
[junit4:junit4] 2> 1039570 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica2 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:52277_xyro%2Ff
[junit4:junit4] 2> 1039583 T1236 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica1 state=down
[junit4:junit4] 2> 1039584 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica3 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:52271_xyro%2Ff
[junit4:junit4] 2> 1039591 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica4 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:52274_xyro%2Ff
[junit4:junit4] 2> 1039600 T1297 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica2 state=down
[junit4:junit4] 2> 1039602 T1271 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica3 state=down
[junit4:junit4] 2> 1039604 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica5 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:52268_xyro%2Ff
[junit4:junit4] 2> 1039609 T1284 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica4 state=down
[junit4:junit4] 2> 1039613 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica1 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:52264_xyro%2Ff
[junit4:junit4] 2> 1039615 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica2 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:52277_xyro%2Ff
[junit4:junit4] 2> 1039639 T1240 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica1 state=down
[junit4:junit4] 2> 1039643 T1255 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica5 state=down
[junit4:junit4] 2> 1039650 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica3 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:52271_xyro%2Ff
[junit4:junit4] 2> 1039653 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica4 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:52274_xyro%2Ff
[junit4:junit4] 2> 1039659 T1246 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica5 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:52268_xyro%2Ff
[junit4:junit4] 2> 1039667 T1299 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica2 state=down
[junit4:junit4] 2> 1039665 T1269 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica3 state=down
[junit4:junit4] 2> 1039676 T1285 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica4 state=down
[junit4:junit4] 2> 1039691 T1257 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica5 state=down
[junit4:junit4] 2> 1040669 T1245 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1040672 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52277_xyro%2Ff_nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52277_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52277/xyro/f"}
[junit4:junit4] 2> 1040696 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52268_xyro%2Ff_nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52268_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52268/xyro/f"}
[junit4:junit4] 2> 1040708 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52271_xyro%2Ff_nodes_used_collection_shard1_replica1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52271_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52271/xyro/f"}
[junit4:junit4] 2> 1040726 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52264_xyro%2Ff_nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52264_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52264/xyro/f"}
[junit4:junit4] 2> 1040739 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard1_replica2",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52277_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52277/xyro/f"}
[junit4:junit4] 2> 1040740 T1245 oasc.Overseer$ClusterStateUpdater.createCollection Create collection awholynewcollection_0 with numShards 4
[junit4:junit4] 2> 1040760 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard1_replica4",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52274_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52274/xyro/f"}
[junit4:junit4] 2> 1040783 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard1_replica1",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52264_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52264/xyro/f"}
[junit4:junit4] 2> 1040803 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard1_replica5",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52268_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52268/xyro/f"}
[junit4:junit4] 2> 1040837 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard1_replica3",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52271_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52271/xyro/f"}
[junit4:junit4] 2> 1040862 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard2_replica1",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52264_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52264/xyro/f"}
[junit4:junit4] 2> 1040893 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard2_replica2",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52277_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52277/xyro/f"}
[junit4:junit4] 2> 1040932 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard2_replica3",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52271_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52271/xyro/f"}
[junit4:junit4] 2> 1040969 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard2_replica5",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52268_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52268/xyro/f"}
[junit4:junit4] 2> 1040999 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard2_replica4",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52274_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52274/xyro/f"}
[junit4:junit4] 2> 1041033 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "shard":"shard3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard3_replica1",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52264_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52264/xyro/f"}
[junit4:junit4] 2> 1041065 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "shard":"shard3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard3_replica3",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52271_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52271/xyro/f"}
[junit4:junit4] 2> 1041095 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "shard":"shard3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard3_replica2",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52277_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52277/xyro/f"}
[junit4:junit4] 2> 1041166 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "shard":"shard3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard3_replica4",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52274_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52274/xyro/f"}
[junit4:junit4] 2> 1041203 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "shard":"shard3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard3_replica5",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52268_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52268/xyro/f"}
[junit4:junit4] 2> 1041250 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "shard":"shard4",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard4_replica1",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52264_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52264/xyro/f"}
[junit4:junit4] 2> 1041275 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "shard":"shard4",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard4_replica3",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52271_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52271/xyro/f"}
[junit4:junit4] 2> 1041296 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "shard":"shard4",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard4_replica2",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52277_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52277/xyro/f"}
[junit4:junit4] 2> 1041326 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "shard":"shard4",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard4_replica4",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52274_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52274/xyro/f"}
[junit4:junit4] 2> 1041359 T1245 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "shard":"shard4",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard4_replica5",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52268_xyro%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52268/xyro/f"}
[junit4:junit4] 2> 1041392 T1319 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1041393 T1290 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1041394 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1041395 T1304 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1041395 T1321 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1041396 T1249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1041397 T1262 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1041399 T1244 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1041512 T1295 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/awholynewcollection_0_shard1_replica2
[junit4:junit4] 2> 1041513 T1295 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 1041515 T1295 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 1041516 T1295 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 1041527 T1295 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 1041528 T1295 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 1041529 T1282 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica4' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1372010994977/awholynewcollection_0_shard1_replica4
[junit4:junit4] 2> 1041530 T1282 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 1041531 T1258 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica5' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/awholynewcollection_0_shard1_replica5
[junit4:junit4] 2> 1041532 T1258 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 1041533 T1268 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica3' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/awholynewcollection_0_shard1_replica3
[junit4:junit4] 2> 1041534 T1268 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 1041537 T1258 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 1041538 T1258 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 1041538 T1268 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 1041539 T1268 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 1041538 T1282 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 1041540 T1282 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 1041547 T1295 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 1041547 T1258 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 1041548 T1268 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 1041551 T1282 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 1041554 T1295 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/awholynewcollection_0_shard1_replica2/'
[junit4:junit4] 2> 1041557 T1296 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/awholynewcollection_0_shard2_replica2
[junit4:junit4] 2> 1041558 T1296 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 1041568 T1296 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1041569 T1296 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 1041568 T1270 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica3' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/awholynewcollection_0_shard2_replica3
[junit4:junit4] 2> 1041571 T1270 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 1041572 T1268 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 1041573 T1258 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 1041583 T1283 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica4' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1372010994977/awholynewcollection_0_shard2_replica4
[junit4:junit4] 2> 1041584 T1283 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 1041584 T1254 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica5' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/awholynewcollection_0_shard2_replica5
[junit4:junit4] 2> 1041586 T1254 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 1041587 T1296 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/awholynewcollection_0_shard2_replica2/'
[junit4:junit4] 2> 1041597 T1282 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 1041598 T1254 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1041599 T1254 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 1041599 T1270 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1041600 T1270 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 1041599 T1283 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1041601 T1283 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 1041604 T1268 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/awholynewcollection_0_shard1_replica3/'
[junit4:junit4] 2> 1041606 T1258 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/awholynewcollection_0_shard1_replica5/'
[junit4:junit4] 2> 1041610 T1271 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica3' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/awholynewcollection_0_shard3_replica3
[junit4:junit4] 2> 1041611 T1271 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 1041611 T1297 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/awholynewcollection_0_shard3_replica2
[junit4:junit4] 2> 1041612 T1297 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 1041616 T1282 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1372010994977/awholynewcollection_0_shard1_replica4/'
[junit4:junit4] 2> 1041623 T1270 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/awholynewcollection_0_shard2_replica3/'
[junit4:junit4] 2> 1041624 T1297 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1041625 T1297 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 1041626 T1254 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/awholynewcollection_0_shard2_replica5/'
[junit4:junit4] 2> 1041628 T1271 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1041628 T1271 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 1041630 T1283 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1372010994977/awholynewcollection_0_shard2_replica4/'
[junit4:junit4] 2> 1041630 T1284 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica4' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1372010994977/awholynewcollection_0_shard3_replica4
[junit4:junit4] 2> 1041631 T1284 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 1041662 T1284 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1041663 T1284 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 1041670 T1255 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica5' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/awholynewcollection_0_shard3_replica5
[junit4:junit4] 2> 1041671 T1255 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 1041678 T1297 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/awholynewcollection_0_shard3_replica2/'
[junit4:junit4] 2> 1041724 T1257 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica5' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/awholynewcollection_0_shard4_replica5
[junit4:junit4] 2> 1041725 T1257 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 1041729 T1285 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica4' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1372010994977/awholynewcollection_0_shard4_replica4
[junit4:junit4] 2> 1041730 T1285 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 1041731 T1299 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/awholynewcollection_0_shard4_replica2
[junit4:junit4] 2> 1041731 T1299 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 1041731 T1269 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica3' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/awholynewcollection_0_shard4_replica3
[junit4:junit4] 2> 1041732 T1269 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 1041744 T1255 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1041744 T1255 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 1041748 T1271 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/awholynewcollection_0_shard3_replica3/'
[junit4:junit4] 2> 1041749 T1284 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1372010994977/awholynewcollection_0_shard3_replica4/'
[junit4:junit4] 2> 1041755 T1285 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1041755 T1285 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 1041755 T1299 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1041756 T1299 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 1041783 T1257 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1041784 T1257 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 1041784 T1269 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1041785 T1269 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 1041793 T1255 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/awholynewcollection_0_shard3_replica5/'
[junit4:junit4] 2> 1041793 T1257 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/awholynewcollection_0_shard4_replica5/'
[junit4:junit4] 2> 1041798 T1285 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1372010994977/awholynewcollection_0_shard4_replica4/'
[junit4:junit4] 2> 1041807 T1299 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1372010997083/awholynewcollection_0_shard4_replica2/'
[junit4:junit4] 2> 1041810 T1269 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/awholynewcollection_0_shard4_replica3/'
[junit4:junit4] 2> 1042144 T1285 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1042250 T1295 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1042331 T1300 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:52268_xyro%2Ff_nodes_used_collection_shard2_replica1, state: recovering, checkLive: true, onlyIfLeader: true for: 3 seconds.
[junit4:junit4] 2> 1042332 T1300 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:52268_xyro%252Ff_nodes_used_collection_shard2_replica1&state=recovering&nodeName=127.0.0.1:52268_xyro%252Ff&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard2_replica2&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=3058
[junit4:junit4] 2> 1042338 T1269 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1042384 T1257 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1042463 T1299 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1042532 T1239 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/awholynewcollection_0_shard1_replica1
[junit4:junit4] 2> 1042533 T1239 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 1042535 T1239 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1042535 T1239 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 1042550 T1235 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/awholynewcollection_0_shard2_replica1
[junit4:junit4] 2> 1042551 T1235 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 1042556 T1235 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1042556 T1235 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 1042556 T1239 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/awholynewcollection_0_shard1_replica1/'
[junit4:junit4] 2> 1042582 T1235 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/awholynewcollection_0_shard2_replica1/'
[junit4:junit4] 2> 1042633 T1236 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/awholynewcollection_0_shard3_replica1
[junit4:junit4] 2> 1042634 T1236 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 1042637 T1236 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1042637 T1236 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 1042668 T1236 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/awholynewcollection_0_shard3_replica1/'
[junit4:junit4] 2> 1042672 T1240 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/awholynewcollection_0_shard4_replica1
[junit4:junit4] 2> 1042672 T1240 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 1042678 T1240 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1042679 T1240 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 1042686 T1240 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1372010989556/awholynewcollection_0_shard4_replica1/'
[junit4:junit4] 2> 1042801 T1283 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1043096 T1285 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1043116 T1285 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1043125 T1285 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica4] Schema name=test
[junit4:junit4] 2> 1043133 T1297 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1043128 T1269 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1043223 T1271 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1043226 T1269 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1043332 T1238 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:52271_xyro%2Ff_nodes_used_collection_shard1_replica1, state: recovering, checkLive: true, onlyIfLeader: true for: 4 seconds.
[junit4:junit4] 2> 1043333 T1238 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:52271_xyro%252Ff_nodes_used_collection_shard1_replica1&state=recovering&nodeName=127.0.0.1:52271_xyro%252Ff&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard1_replica2&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=4040
[junit4:junit4] 2> 1043426 T1269 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica3] Schema name=test
[junit4:junit4] 2> 1043456 T1295 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1043538 T1295 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1043564 T1295 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica2] Schema name=test
[junit4:junit4] 2> 1043753 T1284 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1044035 T1257 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1044045 T1254 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1044107 T1296 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1044108 T1257 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1044141 T1297 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1044153 T1297 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1044202 T1299 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1044241 T1299 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1044339 T1257 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica5] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C6617 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@1d325ad2 url=http://127.0.0.1:52268/xyro/f/nodes_used_collection_shard2_replica1 node=127.0.0.1:52268_xyro%2Ff C6617_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:52268_xyro%2Ff, base_url=http://127.0.0.1:52268/xyro/f}
[junit4:junit4] 2> 1044341 T1316 C6617 P52268 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:52277/xyro/f/nodes_used_collection_shard2_replica2/ core=nodes_used_collection_shard2_replica1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1044342 T1316 C6617 P52268 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica1 url=http://127.0.0.1:52268/xyro/f START replicas=[http://127.0.0.1:52277/xyro/f/nodes_used_collection_shard2_replica2/] nUpdates=100
[junit4:junit4] 2> 1044353 T1316 C6617 P52268 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1044353 T1316 C6617 P52268 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 1044363 T1316 C6617 P52268 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> ASYNC NEW_CORE C6618 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@1d325ad2 url=http://127.0.0.1:52268/xyro/f/nodes_used_collection_shard2_replica1 node=127.0.0.1:52268_xyro%2Ff C6618_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:52268_xyro%2Ff, base_url=http://127.0.0.1:52268/xyro/f}
[junit4:junit4] 2> 1044478 T1316 C6618 P52268 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 1044478 T1316 C6618 P52268 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1044479 T1316 C6618 P52268 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:52277/xyro/f/nodes_used_collection_shard2_replica2/. core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 1044479 T1316 C6618 P52268 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1044476 T1270 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1044476 T1297 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica2] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C6619 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@cd7d0bc url=http://127.0.0.1:52277/xyro/f/nodes_used_collection_shard2_replica2 node=127.0.0.1:52277_xyro%2Ff C6619_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=active, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:52277_xyro%2Ff, base_url=http://127.0.0.1:52277/xyro/f, leader=true}
[junit4:junit4] 2> 1044467 T1298 C6619 P52277 oasc.SolrCore.execute [nodes_used_collection_shard2_replica2] webapp=/xyro/f path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 1044458 T1299 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica2] Schema name=test
[junit4:junit4] 2> 1044458 T1239 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1044386 T1282 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1044885 T1258 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> ASYNC NEW_CORE C6620 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@cd7d0bc url=http://127.0.0.1:52277/xyro/f/nodes_used_collection_shard2_replica2 node=127.0.0.1:52277_xyro%2Ff C6620_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=active, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:52277_xyro%2Ff, base_url=http://127.0.0.1:52277/xyro/f, leader=true}
[junit4:junit4] 2> 1044946 T1298 C6620 P52277 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1044964 T1268 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1045069 T1240 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1045091 T1236 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> ASYNC NEW_CORE C6621 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@cd7d0bc url=http://127.0.0.1:52277/xyro/f/nodes_used_collection_shard2_replica2 node=127.0.0.1:52277_xyro%2Ff C6621_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=active, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:52277_xyro%2Ff, base_url=http://127.0.0.1:52277/xyro/f, leader=true}
[junit4:junit4] 2> 1045154 T1298 C6621 P52277 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4efb8be6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@72501d2c),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1045159 T1298 C6621 P52277 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1045165 T1298 C6621 P52277 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4efb8be6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@72501d2c),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4efb8be6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@72501d2c),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1045166 T1298 C6621 P52277 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1045174 T1298 C6621 P52277 oass.SolrIndexSearcher.<init> Opening Searcher@440aa2fe realtime
[junit4:junit4] 2> 1045175 T1298 C6621 P52277 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1045177 T1298 C6621 P52277 oasup.LogUpdateProcessor.finish [nodes_used_collection_shard2_replica2] webapp=/xyro/f path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 231
[junit4:junit4] 2> ASYNC NEW_CORE C6622 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@1d325ad2 url=http://127.0.0.1:52268/xyro/f/nodes_used_collection_shard2_replica1 node=127.0.0.1:52268_xyro%2Ff C6622_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:52268_xyro%2Ff, base_url=http://127.0.0.1:52268/xyro/f}
[junit4:junit4] 2> 1045185 T1316 C6622 P52268 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1045185 T1316 C6622 P52268 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> ASYNC NEW_CORE C6623 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@cd7d0bc url=http://127.0.0.1:52277/xyro/f/nodes_used_collection_shard2_replica2 node=127.0.0.1:52277_xyro%2Ff C6623_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=active, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:52277_xyro%2Ff, base_url=http://127.0.0.1:52277/xyro/f, leader=true}
[junit4:junit4] 2> 1045285 T1298 C6623 P52277 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1045286 T1298 C6623 P52277 oasc.SolrCore.execute [nodes_used_collection_shard2_replica2] webapp=/xyro/f path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> ASYNC NEW_CORE C6624 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@1d325ad2 url=http://127.0.0.1:52268/xyro/f/nodes_used_collection_shard2_replica1 node=127.0.0.1:52268_xyro%2Ff C6624_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:52268_xyro%2Ff, base_url=http://127.0.0.1:52268/xyro/f}
[junit4:junit4] 2> 1045289 T1316 C6624 P52268 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1045289 T1316 C6624 P52268 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1045290 T1316 C6624 P52268 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1045293 T1300 C6623 P52277 oasc.SolrCore.execute [nodes_used_collection_shard2_replica2] webapp=/xyro/f path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1045295 T1316 C6624 P52268 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1045310 T1316 C6624 P52268 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/nodes_used_collection_shard2_replica1/data/index.20130624044013977
[junit4:junit4] 2> 1045311 T1316 C6624 P52268 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@10174779 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4b686e2e) fullCopy=false
[junit4:junit4] 2> ASYNC NEW_CORE C6625 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore@54514d60 url=http://127.0.0.1:52271/xyro/f/nodes_used_collection_shard1_replica1 node=127.0.0.1:52271_xyro%2Ff C6625_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{shard=shard1, state=recovering, core=nodes_used_collection_shard1_replica1, collection=nodes_used_collection, node_name=127.0.0.1:52271_xyro%2Ff, base_url=http://127.0.0.1:52271/xyro/f}
[junit4:junit4] 2> 1045377 T1317 C6625 P52271 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:52264/xyro/f/nodes_used_collection_shard1_replica2/ core=nodes_used_collection_shard1_replica1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1045378 T1317 C6625 P52271 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica1 url=http://127.0.0.1:52271/xyro/f START replicas=[http://127.0.0.1:52264/xyro/f/nodes_used_collection_shard1_replica2/] nUpdates=100
[junit4:junit4] 2> 1045382 T1317 C6625 P52271 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1045382 T1317 C6625 P52271 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=nodes_used_collection_shard1_replica1
[junit4:junit4] 2> 1045382 T1317 C6625 P52271 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=nodes_used_collection_shard1_replica1
[junit4:junit4] 2> 1045383 T1317 C6625 P52271 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=nodes_used_collection_shard1_replica1
[junit4:junit4] 2> 1045481 T1317 C6625 P52271 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1045481 T1317 C6625 P52271 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:52264/xyro/f/nodes_used_collection_shard1_replica2/. core=nodes_used_collection_shard1_replica1
[junit4:junit4] 2> 1045481 T1317 C6625 P52271 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1045394 T1283 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> ASYNC NEW_CORE C6626 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@cd7d0bc url=http://127.0.0.1:52277/xyro/f/nodes_used_collection_shard2_replica2 node=127.0.0.1:52277_xyro%2Ff C6626_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=active, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:52277_xyro%2Ff, base_url=http://127.0.0.1:52277/xyro/f, leader=true}
[junit4:junit4] 2> 1045394 T1298 C6626 P52277 oasc.SolrCore.execute [nodes_used_collection_shard2_replica2] webapp=/xyro/f path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=1
[junit4:junit4] 2> ASYNC NEW_CORE C6627 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@1d325ad2 url=http://127.0.0.1:52268/xyro/f/nodes_used_collection_shard2_replica1 node=127.0.0.1:52268_xyro%2Ff C6627_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:52268_xyro%2Ff, base_url=http://127.0.0.1:52268/xyro/f}
[junit4:junit4] 2> 1045497 T1316 C6627 P52268 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1045605 T1283 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> ASYNC NEW_CORE C6628 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@1d325ad2 url=http://127.0.0.1:52268/xyro/f/nodes_used_collection_shard2_replica1 node=127.0.0.1:52268_xyro%2Ff C6628_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:52268_xyro%2Ff, base_url=http://127.0.0.1:52268/xyro/f}
[junit4:junit4] 2> 1045607 T1316 C6628 P52268 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1045607 T1316 C6628 P52268 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 1045614 T1283 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica4] Schema name=test
[junit4:junit4] 2> 1045636 T1235 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1045832 T1255 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1045910 T1271 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> ASYNC NEW_CORE C6629 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@1d325ad2 url=http://127.0.0.1:52268/xyro/f/nodes_used_collection_shard2_replica1 node=127.0.0.1:52268_xyro%2Ff C6629_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:52268_xyro%2Ff, base_url=http://127.0.0.1:52268/xyro/f}
[junit4:junit4] 2> 1045921 T1316 C6629 P52268 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@47110aea lockFactory=org.apache.lucene.store.NativeFSLockFactory@73c03ade),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@47110aea lockFactory=org.apache.lucene.store.NativeFSLockFactory@73c03ade),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1045921 T1316 C6629 P52268 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1045922 T1316 C6629 P52268 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1045923 T1316 C6629 P52268 oass.SolrIndexSearcher.<init> Opening Searcher@36ac4e47 main
[junit4:junit4] 2> 1045925 T1311 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica1] Registered new searcher Searcher@36ac4e47 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1045929 T1316 C6629 P52268 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/nodes_used_collection_shard2_replica1/data/index.20130624044013977 [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/nodes_used_collection_shard2_replica1/data/index.20130624044013977;done=true>>]
[junit4:junit4] 2> 1045930 T1316 C6629 P52268 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/nodes_used_collection_shard2_replica1/data/index.20130624044013977
[junit4:junit4] 2> 1045932 T1316 C6629 P52268 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1372010990760/nodes_used_collection_shard2_replica1/data/index.20130624044013977
[junit4:junit4] 2> 1045933 T1316 C6629 P52268 oasc.RecoveryStrategy.replay No replay needed. core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 1045933 T1316 C6629 P52268 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 1045938 T1316 C6629 P52268 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=active
[junit4:junit4] 2> 1045942 T1316 C6629 P52268 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 1045953 T1271 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1045982 T1296 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1045991 T1296 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> ASYNC NEW_CORE C6630 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@628af225 url=http://127.0.0.1:52264/xyro/f/nodes_used_collection_shard1_replica2 node=127.0.0.1:52264_xyro%2Ff C6630_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=active, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:52264_xyro%2Ff, base_url=http://127.0.0.1:52264/xyro/f, leader=true}
[junit4:junit4] 2> 1046085 T1238 C6630 P52264 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1046187 T1296 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica2] Schema name=test
[junit4:junit4] 2> 1046203 T1282 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> ASYNC NEW_CORE C6631 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@628af225 url=http://127.0.0.1:52264/xyro/f/nodes_used_collection_shard1_replica2 node=127.0.0.1:52264_xyro%2Ff C6631_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=active, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:52264_xyro%2Ff, base_url=http://127.0.0.1:52264/xyro/f, leader=true}
[junit4:junit4] 2> 1046266 T1238 C6631 P52264 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ffe5c31 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3805a05b),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1046267 T1238 C6631 P52264 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1046273 T1282 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1046277 T1238 C6631 P52264 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ffe5c31 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3805a05b),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ffe5c31 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3805a05b),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1046278 T1238 C6631 P52264 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1046281 T1238 C6631 P52264 oass.SolrIndexSearcher.<init> Opening Searcher@3cb0fc4d realtime
[junit4:junit4] 2> 1046282 T1238 C6631 P52264 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1046283 T1238 C6631 P52264 oasup.LogUpdateProcessor.finish [nodes_used_collection_shard1_replica2] webapp=/xyro/f path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 198
[junit4:junit4] 2> 1046285 T1317 C6625 P52271 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1046285 T1317 C6625 P52271 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1046289 T1237 C6631 P52264 oasc.SolrCore.execute [nodes_used_collection_shard1_replica2] webapp=/xyro/f path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1046310 T1271 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica3] Schema name=test
[junit4:junit4] 2> 1046336 T1238 C6631 P52264 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> ASYNC NEW_CORE C6632 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@628af225 url=http://127.0.0.1:52264/xyro/f/nodes_used_collection_shard1_replica2 node=127.0.0.1:52264_xyro%2Ff C6632_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=active, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:52264_xyro%2Ff, base_url=http://127.0.0.1:52264/xyro/f, leader=true}
[junit4:junit4] 2> 1046381 T1238 C6632 P52264 oasc.SolrCore.execute [nodes_used_collection_shard1_replica2] webapp=/xyro/f path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=45
[junit4:junit4] 2> 1046384 T1317 C6625 P52271 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1046384 T1317 C6625 P52271 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1046384 T1317 C6625 P52271 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1046381 T1284 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1046401 T1237 C6632 P52264 oasc.SolrCore.execute [nodes_used_collection_shard1_replica2] webapp=/xyro/f path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=7
[junit4:junit4] 2> 1046404 T1317 C6625 P52271 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1046407 T1284 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1046410 T1317 C6625 P52271 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1372010992849/nodes_used_collection_shard1_replica1/data/index.20130624044015087
[junit4:junit4] 2> 1046411 T
[...truncated too long message...]
lection1, node_name=127.0.0.1:53186_, base_url=http://127.0.0.1:53186, leader=true}
[junit4:junit4] 2> 2388764 T3749 C8805 P53186 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@558d7703 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4a9c295),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@558d7703 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4a9c295),segFN=segments_5,generation=5}
[junit4:junit4] 2> 2388765 T3749 C8805 P53186 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 2388769 T3749 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 2388770 T3749 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 2388770 T3749 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1372012275778/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1372012275778/jetty4/index;done=false>>]
[junit4:junit4] 2> 2388771 T3749 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1372012275778/jetty4/index
[junit4:junit4] 2> 2388771 T3749 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1372012275778/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1372012275778/jetty4;done=false>>]
[junit4:junit4] 2> 2388771 T3749 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1372012275778/jetty4
[junit4:junit4] 2> 2388773 T3870 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89916196507222028-127.0.0.1:53186_-n_0000000004) am no longer a leader.
[junit4:junit4] 2> 2388806 T3749 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 2388901 T3749 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 2388905 T3749 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:53169 53169
[junit4:junit4] 2> 2388923 T3823 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 2389011 T3823 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 2389017 T3823 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 2389017 T3749 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 53172
[junit4:junit4] 2> !!!! WARNING: best effort to remove /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-1372012275778 FAILED !!!!!
[junit4:junit4] 2> 2389020 T3749 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 2389021 T3749 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:53169 53169
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=E850B3B75F2D794D -Dtests.slow=true -Dtests.locale=es_PA -Dtests.timezone=Europe/Helsinki -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR 82.0s | ShardSplitTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:53176 returned non ok status:500, message:Server Error
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([E850B3B75F2D794D:69B63DAF28721971]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:228)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:150)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:680)
[junit4:junit4] 2> 2389069 T3749 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 82030 T3748 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 2390086 T3840 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 2390086 T3840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2390087 T3840 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Lucene3x, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=es_PA, timezone=Europe/Helsinki
[junit4:junit4] 2> NOTE: Mac OS X 10.8.4 x86_64/Apple Inc. 1.6.0_51 (64-bit)/cpus=2,threads=1,free=146013184,total=317362176
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestUniqueKeyFieldResource, CoreContainerCoreInitFailuresTest, TestClassNameShortening, DistanceFunctionTest, ZkControllerTest, TestLFUCache, AliasIntegrationTest, TestCharFilters, TestElisionMultitermQuery, TestWordDelimiterFilterFactory, UpdateParamsTest, ZkCLITest, LukeRequestHandlerTest, MBeansHandlerTest, QueryEqualityTest, RequiredFieldsTest, DistributedSpellCheckComponentTest, DocumentBuilderTest, TestUtils, TestFaceting, OpenExchangeRatesOrgProviderTest, OverseerCollectionProcessorTest, TestCopyFieldCollectionResource, TestSchemaResource, TestSerializedLuceneMatchVersion, TestQueryUtils, BadIndexSchemaTest, HighlighterTest, TestDynamicFieldCollectionResource, LeaderElectionTest, UpdateRequestProcessorFactoryTest, TestFunctionQuery, BinaryUpdateRequestHandlerTest, ShowFileRequestHandlerTest, MultiTermTest, TestSolrIndexConfig, SpellPossibilityIteratorTest, TestStressRecovery, SolrTestCaseJ4Test, TestRandomFaceting, DirectSolrConnectionTest, PrimitiveFieldTypeTest, RAMDirectoryFactoryTest, AnalysisAfterCoreReloadTest, SolrRequestParserTest, TestReload, TestComponentsName, TestReversedWildcardFilterFactory, PrimUtilsTest, TestStressLucene, FieldMutatingUpdateProcessorTest, TestDFRSimilarityFactory, TestCloudManagedSchema, ResponseLogComponentTest, UniqFieldsUpdateProcessorFactoryTest, OpenCloseCoreStressTest, TestRandomDVFaceting, TermVectorComponentTest, CollectionsAPIDistributedZkTest, TestFieldTypeCollectionResource, DateMathParserTest, TestPerFieldSimilarity, TestManagedSchemaFieldResource, TestStressReorder, TestSuggestSpellingConverter, ConvertedLegacyTest, DistributedTermsComponentTest, TestSolrQueryParserResource, ZkSolrClientTest, TestDocumentBuilder, NumericFieldsTest, TestXIncludeConfig, CurrencyFieldXmlFileTest, SpellCheckComponentTest, TestCollationField, PreAnalyzedFieldTest, URLClassifyProcessorTest, TestCodecSupport, QueryElevationComponentTest, TestSolrXMLSerializer, TestSchemaVersionResource, FieldAnalysisRequestHandlerTest, SolrIndexSplitterTest, BasicDistributedZkTest, RecoveryZkTest, TestBinaryField, IndexSchemaTest, PolyFieldTest, JsonLoaderTest, SliceStateTest, UnloadDistributedZkTest, DebugComponentTest, SolrInfoMBeanTest, SystemInfoHandlerTest, CacheHeaderTest, NoCacheHeaderTest, AlternateDirectoryTest, TestSolrCoreProperties, DOMUtilTest, LegacyHTMLStripCharFilterTest, RequestHandlersTest, SoftAutoCommitTest, BasicZkTest, TestCollationKeyRangeQueries, OverseerTest, QueryParsingTest, TestLuceneMatchVersion, TestValueSourceCache, ExternalFileFieldSortTest, PingRequestHandlerTest, SynonymTokenizerTest, CircularListTest, SolrCoreCheckLockOnStartupTest, TestLRUCache, TestBinaryResponseWriter, JSONWriterTest, TestMultiCoreConfBootstrap, BadCopyFieldTest, SolrIndexConfigTest, TestCloudManagedSchemaAddField, DirectSolrSpellCheckerTest, TestFastOutputStream, TestCoreContainer, PreAnalyzedUpdateProcessorTest, TestSolrXmlPersistence, DistributedQueryElevationComponentTest, TestRecovery, TestNumberUtils, ShardRoutingTest, TestBadConfig, TestPostingsSolrHighlighter, AutoCommitTest, TestJoin, TestDynamicFieldResource, ShardSplitTest]
[junit4:junit4] Completed in 83.26s, 1 test, 1 error <<< FAILURES!
[...truncated 491 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/build.xml:392: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/build.xml:372: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/build.xml:181: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/solr/common-build.xml:437: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:1246: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:890: There were test failures: 298 suites, 1256 tests, 2 errors, 19 ignored (7 assumptions)
Total time: 117 minutes 6 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.6.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure