You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/04/19 13:53:24 UTC

[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0-ea-b84) - Build # 5242 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/5242/
Java: 64bit/jdk1.8.0-ea-b84 -XX:+UseSerialGC

2 tests failed.
REGRESSION:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Server at http://127.0.0.1:41125/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:41125/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
	at __randomizedtesting.SeedInfo.seed([6C2258CF6AADD74:8724AB9481F5BD48]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:374)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


REGRESSION:  org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch

Error Message:
Still found shard2 in collection test_unload_shard_and_collection

Stack Trace:
java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
	at __randomizedtesting.SeedInfo.seed([6C2258CF6AADD74:8724AB9481F5BD48]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:127)
	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9243 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.601; org.apache.solr.BaseDistributedSearchTestCase; Setting hostContext system property: /
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.607; org.apache.solr.SolrTestCaseJ4; ###Starting testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.608; org.apache.solr.cloud.ZkTestServer; STARTING ZK TEST SERVER
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.608; org.apache.solr.cloud.ZkTestServer$ZKServerMain; Starting server
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.708; org.apache.solr.cloud.ZkTestServer; start zk server on port:49700
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.709; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.766; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@e2bbd4f name:ZooKeeperConnection Watcher:127.0.0.1:49700 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.766; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.767; org.apache.solr.common.cloud.SolrZkClient; makePath: /solr
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.772; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.773; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@ec52fa name:ZooKeeperConnection Watcher:127.0.0.1:49700/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.773; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.774; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.776; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/shards
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.778; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.780; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/shards
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.782; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.782; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.786; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.787; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.789; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.790; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.792; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.792; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.794; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.794; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.797; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.798; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.800; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.800; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.802; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.803; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.805; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.805; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.867; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.901; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:33008
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.902; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.902; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.902; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1366371689808
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.903; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1366371689808/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.903; org.apache.solr.core.CoreContainer; New CoreContainer 1898340788
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.904; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1366371689808/'
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.904; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1366371689808/'
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.970; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.971; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.971; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.971; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.972; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.972; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.972; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.972; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.973; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.973; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.976; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.976; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:49700/solr
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.977; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.977; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.979; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1c4ed340 name:ZooKeeperConnection Watcher:127.0.0.1:49700 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.979; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.982; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.984; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.985; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@5ebf1854 name:ZooKeeperConnection Watcher:127.0.0.1:49700/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.986; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.987; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.989; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/collection-queue-work
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.991; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.992; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33008_
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.993; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:33008_
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.995; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/election
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:29.998; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.000; org.apache.solr.cloud.Overseer; Overseer (id=89546535050280963-127.0.0.1:33008_-n_0000000000) starting
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.002; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue-work
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.004; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.004; org.apache.solr.common.cloud.SolrZkClient; makePath: /clusterstate.json
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.006; org.apache.solr.common.cloud.SolrZkClient; makePath: /aliases.json
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.007; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.009; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.011; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1366371689808/collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.011; org.apache.solr.cloud.ZkController; Check for collection zkNode:control_collection
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.011; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.012; org.apache.solr.cloud.ZkController; Load collection config from:/collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.012; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1366371689808/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.013; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1366371689808/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.013; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1366371689808/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.033; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.058; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.060; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.063; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.355; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.359; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.361; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.370; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.373; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.375; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:30.376; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:30.376; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.376; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:30.377; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:30.377; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.378; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.378; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1366371689808/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/control/data/
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.378; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12d52f60
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.378; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.379; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/control/data
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.379; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/control/data/index/
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:30.379; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.380; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/control/data/index
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.381; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1c07d29f lockFactory=org.apache.lucene.store.NativeFSLockFactory@73bde40a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.381; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.382; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.383; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.383; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.384; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.384; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.384; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.384; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.384; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.385; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.387; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.389; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@393f443e main
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.389; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/control/data/tlog
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.390; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.390; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.392; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@393f443e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.392; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:30.393; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:31.512; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:31.512; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:33008_",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:33008",
[junit4:junit4]   1>   "shard":null}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:31.512; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection control_collection with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:31.513; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:31.515; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:32.394; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:32.394; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:33008 collection:control_collection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:32.395; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:32.400; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:32.401; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:32.402; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:32.402; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:33008/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:32.402; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:32.402; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:33008/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:32.403; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:33008/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:32.403; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.018; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.023; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.058; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:33008/collection1/ and leader is http://127.0.0.1:33008/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.058; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33008
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.058; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.059; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.059; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.060; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.062; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.062; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.063; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.075; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.077; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.078; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@60e4f165 name:ZooKeeperConnection Watcher:127.0.0.1:49700/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.078; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.080; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.082; org.apache.solr.cloud.ChaosMonkey; monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.157; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.159; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:37316
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.160; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.160; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.161; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366371693082
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.161; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366371693082/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.162; org.apache.solr.core.CoreContainer; New CoreContainer 832306389
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.162; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366371693082/'
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.162; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366371693082/'
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.224; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.225; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.225; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.226; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.226; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.226; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.227; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.227; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.227; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.228; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.231; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.232; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:49700/solr
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.232; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.233; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.234; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@45941837 name:ZooKeeperConnection Watcher:127.0.0.1:49700 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.235; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.237; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.239; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.240; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@536369c0 name:ZooKeeperConnection Watcher:127.0.0.1:49700/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.241; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:33.244; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.246; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37316_
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.249; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:37316_
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.252; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.252; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.252; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.252; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.266; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366371693082/collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.266; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.267; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.267; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.268; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366371693082/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.269; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366371693082/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.269; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366371693082/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.290; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.315; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.316; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.319; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.526; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.527; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:33008__collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:33008_",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:33008",
[junit4:junit4]   1>   "shard":"shard1"}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.530; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.530; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.530; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.640; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.645; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.647; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.656; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.659; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.662; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:34.663; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:34.663; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.663; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:34.664; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:34.664; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.665; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.665; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366371693082/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty1/
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.665; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12d52f60
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.665; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.666; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.666; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty1/index/
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:34.666; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.667; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty1/index
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.668; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@337d72bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@27f25954),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.668; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.670; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.670; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.670; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.671; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.671; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.671; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.672; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.672; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.672; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.674; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.677; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@7e4dfabf main
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.677; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty1/tlog
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.677; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.678; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.680; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@7e4dfabf main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.682; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:34.682; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:36.034; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:36.035; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:37316_",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:37316",
[junit4:junit4]   1>   "shard":null}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:36.035; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection collection1 with numShards 2
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:36.035; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:36.038; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:36.038; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:36.038; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:36.683; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:36.684; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:37316 collection:collection1 shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:36.685; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:36.690; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:36.691; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:36.691; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:36.692; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:37316/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:36.692; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:36.692; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:37316/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:36.692; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:37316/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:36.692; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.542; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.549; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.549; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.549; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.599; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:37316/collection1/ and leader is http://127.0.0.1:37316/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.599; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:37316
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.599; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.599; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.599; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.601; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.602; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.603; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.603; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.663; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.665; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:41125
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.666; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.666; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.667; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1366371697606
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.667; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1366371697606/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.667; org.apache.solr.core.CoreContainer; New CoreContainer 1327815306
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.668; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1366371697606/'
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.668; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1366371697606/'
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.736; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.737; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.737; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.737; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.738; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.738; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.738; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.739; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.739; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.739; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.742; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.742; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:49700/solr
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.743; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.743; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.745; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@b8f4052 name:ZooKeeperConnection Watcher:127.0.0.1:49700 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.745; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.747; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.750; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.751; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@33d2fc64 name:ZooKeeperConnection Watcher:127.0.0.1:49700/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.751; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:37.755; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:38.757; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41125_
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:38.758; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:41125_
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:38.759; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:38.760; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:38.760; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:38.760; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:38.761; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:38.761; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:38.762; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:38.765; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1366371697606/collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:38.765; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:38.765; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:38.766; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:38.766; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1366371697606/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:38.767; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1366371697606/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:38.767; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1366371697606/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:38.788; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:38.824; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:38.825; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:38.828; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.053; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.054; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:37316__collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:37316_",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:37316",
[junit4:junit4]   1>   "shard":"shard2"}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.057; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.057; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.057; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.058; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.133; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.137; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.139; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.149; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.152; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.155; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:39.156; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:39.156; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.156; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:39.157; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:39.157; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.157; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.158; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1366371697606/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty2/
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.158; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12d52f60
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.158; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.159; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty2
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.159; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty2/index/
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:39.159; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.160; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty2/index
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.161; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3be42793 lockFactory=org.apache.lucene.store.NativeFSLockFactory@32fab595),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.161; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.162; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.163; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.163; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.164; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.164; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.164; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.164; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.165; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.165; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.167; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.169; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@50e21d08 main
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.169; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty2/tlog
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.170; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.170; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.173; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@50e21d08 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.174; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:39.174; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:40.561; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:40.562; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:41125_",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:41125",
[junit4:junit4]   1>   "shard":null}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:40.562; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:40.563; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:40.568; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:40.569; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:40.569; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:40.569; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:41.176; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:41.176; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:41125 collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:41.177; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:41.181; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:41.183; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:41.183; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:41.183; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:41125/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:41.184; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:41.184; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:41125/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:41.184; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:41125/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:41.184; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.071; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.076; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.076; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.076; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.076; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.090; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:41125/collection1/ and leader is http://127.0.0.1:41125/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.090; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:41125
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.090; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.090; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.091; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.092; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.092; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.093; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.093; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.156; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.158; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:59386
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.158; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.159; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.159; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1366371702096
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.159; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1366371702096/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.160; org.apache.solr.core.CoreContainer; New CoreContainer 1349209204
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.160; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1366371702096/'
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.161; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1366371702096/'
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.228; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.229; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.229; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.230; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.230; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.230; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.231; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.231; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.231; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.232; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.234; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.234; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:49700/solr
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.235; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.236; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.238; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@68715e91 name:ZooKeeperConnection Watcher:127.0.0.1:49700 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.239; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.241; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.243; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.244; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@69e781c1 name:ZooKeeperConnection Watcher:127.0.0.1:49700/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.245; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:42.247; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.250; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59386_
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.251; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:59386_
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.253; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.254; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.254; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.254; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.255; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.254; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.254; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.255; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.256; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.259; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1366371702096/collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.259; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.259; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.260; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.261; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1366371702096/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.261; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1366371702096/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.261; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1366371702096/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.282; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.318; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.319; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.322; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.580; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.581; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:41125__collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:41125_",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:41125",
[junit4:junit4]   1>   "shard":"shard1"}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.584; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.584; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.584; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.584; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.584; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.662; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.667; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.669; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.689; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.692; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.696; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:43.697; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:43.697; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.698; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:43.699; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:43.699; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.699; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.700; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1366371702096/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty3/
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.700; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12d52f60
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.700; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.701; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty3
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.701; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty3/index/
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:43.702; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.702; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty3/index
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.704; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7f56dcfa lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c366805),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.704; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.706; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.707; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.707; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.707; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.708; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.708; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.708; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.709; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.709; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.711; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.713; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@7e098794 main
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.714; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty3/tlog
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.714; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.714; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.718; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@7e098794 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.720; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:43.720; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.097; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.098; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:59386_",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:59386",
[junit4:junit4]   1>   "shard":null}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.098; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.098; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.101; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.101; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.101; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.101; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.101; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.722; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.723; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:59386 collection:collection1 shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.726; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:59386/collection1/ and leader is http://127.0.0.1:37316/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.726; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59386
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.726; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.726; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.727; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.727; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.727; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.727; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.728; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.728; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.729; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.729; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.729; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.733; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:59386__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.797; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.799; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:50686
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.800; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.800; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.801; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1366371705732
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.801; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1366371705732/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.801; org.apache.solr.core.CoreContainer; New CoreContainer 580352905
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.802; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1366371705732/'
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.802; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1366371705732/'
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.875; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.875; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.876; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.876; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.876; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.877; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.877; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.877; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.878; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.878; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.881; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.881; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:49700/solr
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.882; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.882; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.884; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@50df5717 name:ZooKeeperConnection Watcher:127.0.0.1:49700 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.884; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.886; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.889; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.890; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@7a0de430 name:ZooKeeperConnection Watcher:127.0.0.1:49700/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.890; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:45.893; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.604; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.605; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:59386__collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:59386_",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:59386",
[junit4:junit4]   1>   "shard":"shard2"}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.609; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.609; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.609; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.609; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.610; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.609; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.733; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:59386__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.734; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={onlyIfLeader=true&core=collection1&nodeName=127.0.0.1:59386_&wt=javabin&version=2&coreNodeName=127.0.0.1:59386__collection1&state=recovering&checkLive=true&action=PREPRECOVERY} status=0 QTime=1001 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.896; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50686_
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.897; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:50686_
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.899; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.899; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.900; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.900; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.899; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.899; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.900; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.900; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.901; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.901; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.902; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.902; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.905; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1366371705732/collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.905; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.905; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.905; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.906; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1366371705732/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.907; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1366371705732/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.907; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1366371705732/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.935; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.962; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.964; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:46.967; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.326; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.331; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.333; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.341; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.344; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.347; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:47.347; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:47.348; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.348; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:47.349; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:47.349; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.349; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.350; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1366371705732/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty4/
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.350; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12d52f60
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.350; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.351; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty4
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.351; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty4/index/
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:47.351; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.351; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty4/index
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.353; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3df2e807 lockFactory=org.apache.lucene.store.NativeFSLockFactory@301c6530),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.353; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.355; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.355; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.355; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.356; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.356; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.356; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.356; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.357; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.357; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.359; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.361; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@56cd95d5 main
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.362; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty4/tlog
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.362; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.362; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.366; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@56cd95d5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.367; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:47.368; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.113; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.114; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:50686_",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:50686",
[junit4:junit4]   1>   "shard":null}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.115; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.115; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.119; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.119; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.119; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.119; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.119; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.119; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.369; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.369; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:50686 collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.372; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:50686/collection1/ and leader is http://127.0.0.1:41125/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.372; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50686
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.373; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.373; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.373; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.374; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.374; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.374; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.374; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.375; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.376; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.376; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.377; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.381; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.381; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:50686__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.382; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.385; org.apache.solr.core.CoreContainer; Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366371693082/onenodecollectioncore
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.386; org.apache.solr.cloud.ZkController; Check for collection zkNode:onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.387; org.apache.solr.cloud.ZkController; Creating collection in ZooKeeper:onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.387; org.apache.solr.cloud.ZkController; Looking for collection configName
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.388; org.apache.solr.cloud.ZkController; Only one config set found in zk - using it:conf1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.388; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.391; org.apache.solr.cloud.ZkController; Load collection config from:/collections/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.392; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366371693082/onenodecollectioncore/'
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.438; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.474; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.476; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.482; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.734; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:37316/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.735; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:59386 START replicas=[http://127.0.0.1:37316/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:48.735; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.736; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.736; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.736; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.736; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.737; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:37316/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.737; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.740; org.apache.solr.core.SolrCore; [collection1] webapp= path=/get params={wt=javabin&getVersions=100&version=2&qt=/get&distrib=false} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.740; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.742; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@337d72bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@27f25954),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.742; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.742; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@337d72bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@27f25954),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@337d72bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@27f25954),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.743; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.743; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@754b1545 realtime
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.743; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.744; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={commit=true&wt=javabin&version=2&waitSearcher=true&commit_end_point=true&softCommit=false&openSearcher=false} {commit=} 0 4
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.744; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.745; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.759; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.760; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={wt=javabin&version=2&qt=/replication&command=indexversion} status=0 QTime=14 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.760; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.760; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.760; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.762; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={generation=2&wt=javabin&version=2&qt=/replication&command=filelist} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.763; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.764; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty3/index.20130419211148763
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.764; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@479c8dc6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ee3b720) fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.766; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={generation=2&wt=filestream&file=segments_2&checksum=true&qt=/replication&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.767; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.768; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.768; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.769; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7f56dcfa lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c366805),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7f56dcfa lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c366805),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.769; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.769; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.770; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@440906b3 main
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.770; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@440906b3 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.771; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty3/index.20130419211148763 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty3/index.20130419211148763;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.771; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty3/index.20130419211148763
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.771; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty3/index.20130419211148763
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.771; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.772; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.772; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.772; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.773; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.825; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.829; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.831; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.842; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.845; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.848; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:48.849; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:48.849; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.850; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:48.851; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:48.851; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.851; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.852; org.apache.solr.core.SolrCore; [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366371693082/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1366371689607/onenodecollection/
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.852; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12d52f60
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.852; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.853; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1366371689607/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.853; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1366371689607/onenodecollection/index/
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:48.854; org.apache.solr.core.SolrCore; [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1366371689607/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.854; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1366371689607/onenodecollection/index
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.855; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4994de6b lockFactory=org.apache.lucene.store.NativeFSLockFactory@67ddb284),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.856; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.857; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.858; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.858; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.858; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.859; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.859; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.859; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.860; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.860; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.862; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.864; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1be79239 main
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.865; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1366371689607/onenodecollection/tlog
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.865; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.866; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.868; org.apache.solr.core.SolrCore; [onenodecollectioncore] Registered new searcher Searcher@1be79239 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:48.869; org.apache.solr.cloud.ZkController; publishing core=onenodecollectioncore state=down
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.622; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.623; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:50686__collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:50686_",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:50686",
[junit4:junit4]   1>   "shard":"shard1"}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.625; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:59386__collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:59386_",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:59386",
[junit4:junit4]   1>   "shard":"shard2"}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.628; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "core":"onenodecollectioncore",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:37316_",
[junit4:junit4]   1>   "roles":"none",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "collection":"onenodecollection",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:37316",
[junit4:junit4]   1>   "shard":null}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.628; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection onenodecollection with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.628; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.631; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.631; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.631; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.631; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.631; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.631; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.871; org.apache.solr.core.CoreContainer; registering core: onenodecollectioncore
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.871; org.apache.solr.cloud.ZkController; Register replica - core:onenodecollectioncore address:http://127.0.0.1:37316 collection:onenodecollection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.872; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.880; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.882; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.882; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.882; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:37316/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.883; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.883; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:37316/onenodecollectioncore/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.883; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:37316/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:49.883; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:50.382; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:50686__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:50.383; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={onlyIfLeader=true&core=collection1&nodeName=127.0.0.1:50686_&wt=javabin&version=2&coreNodeName=127.0.0.1:50686__collection1&state=recovering&checkLive=true&action=PREPRECOVERY} status=0 QTime=2002 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:51.138; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:51.145; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:51.145; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:51.145; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:51.145; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:51.145; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:51.145; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:51.192; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:37316/onenodecollectioncore/ and leader is http://127.0.0.1:37316/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:51.192; org.apache.solr.cloud.ZkController; No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:37316
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:51.193; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:51.193; org.apache.solr.cloud.ZkController; publishing core=onenodecollectioncore state=active
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:51.195; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:51.196; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={wt=javabin&version=2&roles=none&name=onenodecollectioncore&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1366371689607/onenodecollection&collection=onenodecollection&numShards=1&action=CREATE} status=0 QTime=2811 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:51.197; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:51.198; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.199; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.384; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:41125/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.384; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:50686 START replicas=[http://127.0.0.1:41125/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-19 11:41:52.385; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.385; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.385; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.385; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.385; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.386; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:41125/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.386; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.388; org.apache.solr.core.SolrCore; [collection1] webapp= path=/get params={wt=javabin&getVersions=100&version=2&qt=/get&distrib=false} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.391; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.392; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3be42793 lockFactory=org.apache.lucene.store.NativeFSLockFactory@32fab595),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.393; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.393; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3be42793 lockFactory=org.apache.lucene.store.NativeFSLockFactory@32fab595),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3be42793 lockFactory=org.apache.lucene.store.NativeFSLockFactory@32fab595),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.394; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.394; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@373aef97 realtime
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.395; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.395; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={commit=true&wt=javabin&version=2&waitSearcher=true&commit_end_point=true&softCommit=false&openSearcher=false} {commit=} 0 4
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.396; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.396; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.398; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.398; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={wt=javabin&version=2&qt=/replication&command=indexversion} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.398; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.399; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.399; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.400; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={generation=2&wt=javabin&version=2&qt=/replication&command=filelist} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.401; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.402; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty4/index.20130419211152401
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.402; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@60b4ba67 lockFactory=org.apache.lucene.store.NativeFSLockFactory@142b5a5) fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.404; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={generation=2&wt=filestream&file=segments_2&checksum=true&qt=/replication&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.405; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.405; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.405; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.406; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3df2e807 lockFactory=org.apache.lucene.store.NativeFSLockFactory@301c6530),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3df2e807 lockFactory=org.apache.lucene.store.NativeFSLockFactory@301c6530),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.407; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.407; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.407; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@36a1fe98 main
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.408; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@36a1fe98 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.408; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty4/index.20130419211152401 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty4/index.20130419211152401;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.409; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty4/index.20130419211152401
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.409; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/jetty4/index.20130419211152401
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.409; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.409; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.409; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.409; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.426; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.650; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.651; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "core":"onenodecollectioncore",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:37316__onenodecollectioncore",
[junit4:junit4]   1>   "node_name":"127.0.0.1:37316_",
[junit4:junit4]   1>   "roles":"none",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "collection":"onenodecollection",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:37316",
[junit4:junit4]   1>   "shard":"shard1"}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.653; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:50686__collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:50686_",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:50686",
[junit4:junit4]   1>   "shard":"shard1"}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.656; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.656; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.656; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.656; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.656; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:52.656; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:53.201; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:53.202; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished - collection: onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:53.202; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:53.207; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:53.208; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@14fce2ef name:ZooKeeperConnection Watcher:127.0.0.1:49700 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:53.208; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> / (2)
[junit4:junit4]   1> DATA:
[junit4:junit4]   1>     
[junit4:junit4]   1>  /solr (7)
[junit4:junit4]   1>   /solr/aliases.json (0)
[junit4:junit4]   1>   /solr/overseer_elect (2)
[junit4:junit4]   1>    /solr/overseer_elect/leader (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"id":"89546535050280963-127.0.0.1:33008_-n_0000000000"}
[junit4:junit4]   1>    /solr/overseer_elect/election (5)
[junit4:junit4]   1>     /solr/overseer_elect/election/89546535050280970-127.0.0.1:59386_-n_0000000003 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89546535050280972-127.0.0.1:50686_-n_0000000004 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89546535050280966-127.0.0.1:37316_-n_0000000001 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89546535050280968-127.0.0.1:41125_-n_0000000002 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89546535050280963-127.0.0.1:33008_-n_0000000000 (0)
[junit4:junit4]   1>   /solr/live_nodes (5)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:59386_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:33008_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:50686_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:37316_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:41125_ (0)
[junit4:junit4]   1>   /solr/overseer (3)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       
[junit4:junit4]   1>    /solr/overseer/queue (0)
[junit4:junit4]   1>    /solr/overseer/queue-work (0)
[junit4:junit4]   1>    /solr/overseer/collection-queue-work (0)
[junit4:junit4]   1>   /solr/configs (1)
[junit4:junit4]   1>    /solr/configs/conf1 (9)
[junit4:junit4]   1>     /solr/configs/conf1/synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/currency.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/old_synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/schema.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/stopwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/solrconfig.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/protwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/open-exchange-rates.json (0)
[junit4:junit4]   1>     DATA:
[junit4:junit4]   1>         {
[junit4:junit4]   1>           "disclaimer": "This data is not real, it was synthetically created to match currency.xml.  It is modeled after the data format available from openexchangerates.org.  See https://openexchangerates.org/documentation for details",
[junit4:junit4]   1>           "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4:junit4]   1>           "timestamp": 1332070464,
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "IMPORTANT NOTE": "In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "base": "USD",
[junit4:junit4]   1>           "rates": {
[junit4:junit4]   1>             "USD": 1,
[junit4:junit4]   1>             "JPY": 81.29,
[junit4:junit4]   1>             "EUR": 2.5,
[junit4:junit4]   1>             "GBP": 0.5,
[junit4:junit4]   1>             "MXN": 2.0
[junit4:junit4]   1>           }
[junit4:junit4]   1>         }
[junit4:junit4]   1>         
[junit4:junit4]   1>   /solr/collections (3)
[junit4:junit4]   1>    /solr/collections/control_collection (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/control_collection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/shard1/election/89546535050280963-127.0.0.1:33008__collection1-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:33008_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:33008"}
[junit4:junit4]   1>     /solr/collections/control_collection/shards (0)
[junit4:junit4]   1>    /solr/collections/collection1 (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/collection1/leader_elect (2)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard2 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard2/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89546535050280966-127.0.0.1:37316__collection1-n_0000000000 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89546535050280970-127.0.0.1:59386__collection1-n_0000000001 (0)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard1/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89546535050280972-127.0.0.1:50686__collection1-n_0000000001 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89546535050280968-127.0.0.1:41125__collection1-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/collection1/leaders (2)
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard2 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:37316_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:37316"}
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:41125_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:41125"}
[junit4:junit4]   1>     /solr/collections/collection1/shards (0)
[junit4:junit4]   1>    /solr/collections/onenodecollection (2)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {
[junit4:junit4]   1>          "configName":"conf1",
[junit4:junit4]   1>          "router":"compositeId"}
[junit4:junit4]   1>     /solr/collections/onenodecollection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/onenodecollection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/onenodecollection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/onenodecollection/leader_elect/shard1/election/89546535050280966-127.0.0.1:37316__onenodecollectioncore-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/onenodecollection/leaders (1)
[junit4:junit4]   1>      /solr/collections/onenodecollection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"onenodecollectioncore",
[junit4:junit4]   1>            "node_name":"127.0.0.1:37316_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:37316"}
[junit4:junit4]   1>   /solr/clusterstate.json (0)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       {
[junit4:junit4]   1>         "collection1":{
[junit4:junit4]   1>           "router":"compositeId",
[junit4:junit4]   1>           "shards":{
[junit4:junit4]   1>             "shard1":{
[junit4:junit4]   1>               "range":"80000000-ffffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "127.0.0.1:41125__collection1":{
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:41125_",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:41125",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "127.0.0.1:50686__collection1":{
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:50686_",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:50686",
[junit4:junit4]   1>                   "shard":"shard1"}}},
[junit4:junit4]   1>             "shard2":{
[junit4:junit4]   1>               "range":"0-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "127.0.0.1:37316__collection1":{
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:37316_",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:37316",
[junit4:junit4]   1>                   "shard":"shard2",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "127.0.0.1:59386__collection1":{
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:59386_",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:59386",
[junit4:junit4]   1>                   "shard":"shard2"}}}}},
[junit4:junit4]   1>         "control_collection":{
[junit4:junit4]   1>           "router":"compositeId",
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"127.0.0.1:33008__collection1":{
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:33008_",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "collection":"control_collection",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:33008",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "leader":"true"}}}}},
[junit4:junit4]   1>         "onenodecollection":{
[junit4:junit4]   1>           "router":"compositeId",
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"127.0.0.1:37316__onenodecollectioncore":{
[junit4:junit4]   1>                   "core":"onenodecollectioncore",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:37316_",
[junit4:junit4]   1>                   "roles":"none",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "collection":"onenodecollection",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:37316",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "leader":"true"}}}}}}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:53.244; org.apache.solr.cloud.ChaosMonkey; monkey: stop shard! 33008
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:53.257; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=1898340788
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:54.162; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:54.162; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=null message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:33008__collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:33008_",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:33008",
[junit4:junit4]   1>   "shard":"shard1"}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:54.165; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:54.165; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:54.165; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:54.165; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:54.165; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.259; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.259; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.261; org.apache.solr.core.SolrCore; [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@7dea2e96
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.264; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.264; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.264; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.265; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.265; org.apache.solr.core.SolrCore; [collection1] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.265; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.266; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/control/data/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/control/data/index;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.266; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/control/data/index
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.266; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/control/data [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/control/data;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.267; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1366371689607/control/data
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.267; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89546535050280963-127.0.0.1:33008_-n_0000000000) am no longer a leader.
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.269; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.269; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.269; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.269; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.270; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.270; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.271; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.271; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.272; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.273; org.apache.solr.cloud.Overseer; Overseer (id=89546535050280966-127.0.0.1:37316_-n_0000000001) starting
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.279; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.279; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.281; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 11:41:55.282; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:33008__collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:33008_",
[junit4:junit4]  

[...truncated too long message...]

.solr.core.SolrCore; [unloadcollection4]  CLOSING SolrCore org.apache.solr.core.SolrCore@430e3598
[junit4:junit4]   1> INFO  - 2013-04-19 11:45:31.011; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=3,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-19 11:45:31.012; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-19 11:45:31.012; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-19 11:45:31.012; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-19 11:45:31.013; org.apache.solr.core.SolrCore; [unloadcollection4] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-19 11:45:31.014; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-19 11:45:31.014; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1366371793527/1366371816018unloadcollection_4n/index.20130419114348570 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1366371793527/1366371816018unloadcollection_4n/index.20130419114348570;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-19 11:45:31.014; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1366371793527/1366371816018unloadcollection_4n/index.20130419114348570
[junit4:junit4]   1> INFO  - 2013-04-19 11:45:31.015; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1366371793527/1366371816018unloadcollection_4n [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1366371793527/1366371816018unloadcollection_4n;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-19 11:45:31.015; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1366371793527/1366371816018unloadcollection_4n
[junit4:junit4]   1> INFO  - 2013-04-19 11:45:31.016; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89546541860716556-127.0.0.1:40923_-n_0000000004) am no longer a leader.
[junit4:junit4]   1> INFO  - 2013-04-19 11:45:31.018; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (0)
[junit4:junit4]   1> INFO  - 2013-04-19 11:45:31.018; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 0)
[junit4:junit4]   1> INFO  - 2013-04-19 11:45:31.040; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4]   1> INFO  - 2013-04-19 11:45:31.094; org.apache.solr.SolrTestCaseJ4; ###Ending testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-19 11:45:31.096; org.apache.solr.cloud.ZkTestServer; connecting to 127.0.0.1:49291 49291
[junit4:junit4]   1> INFO  - 2013-04-19 11:45:31.198; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@7862dc4b name:ZooKeeperConnection Watcher:127.0.0.1:49291/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 11:45:31.198; org.apache.solr.common.cloud.ConnectionManager; Client->ZooKeeper status change trigger but we are already closed
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1366371793527
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=UnloadDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=6C2258CF6AADD74 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr_BE -Dtests.timezone=UTC -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE  138s J1 | UnloadDistributedZkTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([6C2258CF6AADD74:8724AB9481F5BD48]:0)
[junit4:junit4]    > 	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:127)
[junit4:junit4]    > 	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   1> INFO  - 2013-04-19 11:45:31.206; org.apache.solr.SolrTestCaseJ4; ###deleteCore
[junit4:junit4]   2> 137700 T2222 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4]   1> WARN  - 2013-04-19 11:45:32.318; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-19 11:45:32.318; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> WARN  - 2013-04-19 11:45:32.318; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {other_tl1=Lucene41(blocksize=128), _version_=Lucene41(blocksize=128), range_facet_l=PostingsFormat(name=MockSep), timestamp=PostingsFormat(name=MockSep), range_facet_sl=PostingsFormat(name=Asserting), id=PostingsFormat(name=Asserting), a_t=PostingsFormat(name=MockSep), intDefault=Lucene41(blocksize=128), range_facet_si=PostingsFormat(name=MockSep), multiDefault=PostingsFormat(name=MockSep), text=PostingsFormat(name=NestedPulsing), a_si=Lucene41(blocksize=128)}, docValues:{timestamp=DocValuesFormat(name=Asserting)}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=fr_BE, timezone=UTC
[junit4:junit4]   2> NOTE: Linux 3.2.0-40-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=1,free=127852752,total=279556096
[junit4:junit4]   2> NOTE: All tests run in this JVM: [CollectionsAPIDistributedZkTest, IndexReaderFactoryTest, CurrencyFieldXmlFileTest, EchoParamsTest, SolrCmdDistributorTest, SignatureUpdateProcessorFactoryTest, TestComponentsName, HighlighterTest, UniqFieldsUpdateProcessorFactoryTest, TestCoreDiscovery, TestUniqueKeyFieldResource, CoreContainerCoreInitFailuresTest, RequestHandlersTest, TestUpdate, TestCollationField, TestMultiCoreConfBootstrap, TestCSVLoader, FileUtilsTest, TestLMJelinekMercerSimilarityFactory, TestFoldingMultitermQuery, ChaosMonkeySafeLeaderTest, TestSolrXMLSerializer, UpdateParamsTest, XmlUpdateRequestHandlerTest, TestAnalyzedSuggestions, TestRecovery, SpellPossibilityIteratorTest, TestElisionMultitermQuery, OpenExchangeRatesOrgProviderTest, TestSolrJ, TestStressReorder, DocValuesMultiTest, MultiTermTest, TestOmitPositions, DirectUpdateHandlerTest, TestLuceneMatchVersion, TestJmxMonitoredMap, OpenCloseCoreStressTest, PingRequestHandlerTest, TestReload, TestZkChroot, AliasIntegrationTest, ClusterStateTest, DOMUtilTest, TimeZoneUtilsTest, TestRandomFaceting, TestQuerySenderNoQuery, FieldAnalysisRequestHandlerTest, BasicDistributedZk2Test, StatsComponentTest, TestDefaultSearchFieldResource, TestSuggestSpellingConverter, TestHashPartitioner, ConvertedLegacyTest, NoCacheHeaderTest, SolrTestCaseJ4Test, TestJmxIntegration, TestLazyCores, CopyFieldTest, DebugComponentTest, NumericFieldsTest, FullSolrCloudDistribCmdsTest, SolrIndexConfigTest, TestAtomicUpdateErrorCases, TestSystemIdResolver, TestMergePolicyConfig, TestPartialUpdateDeduplication, BadCopyFieldTest, TestBinaryResponseWriter, PathHierarchyTokenizerFactoryTest, UnloadDistributedZkTest]
[junit4:junit4] Completed on J1 in 138.99s, 1 test, 1 failure <<< FAILURES!

[...truncated 441 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:375: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:355: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1231: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:875: There were test failures: 290 suites, 1202 tests, 1 error, 1 failure, 13 ignored (7 assumptions)

Total time: 37 minutes 19 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0-ea-b84 -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0-ea-b84) - Build # 5244 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/5244/
Java: 32bit/jdk1.8.0-ea-b84 -client -XX:+UseConcMarkSweepGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch

Error Message:
Still found shard2 in collection test_unload_shard_and_collection

Stack Trace:
java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
	at __randomizedtesting.SeedInfo.seed([E368F9F1DD4785A9:628E77E9AA18E595]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:127)
	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9349 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.UnloadDistributedZkTest
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.086; org.apache.solr.BaseDistributedSearchTestCase; Setting hostContext system property: /vf/g
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.090; org.apache.solr.SolrTestCaseJ4; ###Starting testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.091; org.apache.solr.cloud.ZkTestServer; STARTING ZK TEST SERVER
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.091; org.apache.solr.cloud.ZkTestServer$ZKServerMain; Starting server
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.192; org.apache.solr.cloud.ZkTestServer; start zk server on port:52732
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.193; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.232; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1f987d0 name:ZooKeeperConnection Watcher:127.0.0.1:52732 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.233; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.234; org.apache.solr.common.cloud.SolrZkClient; makePath: /solr
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.240; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.242; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@13e6a5f name:ZooKeeperConnection Watcher:127.0.0.1:52732/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.242; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.243; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.248; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/shards
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.251; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.254; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/shards
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.257; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.258; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.264; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.265; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.270; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.271; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.275; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.276; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.280; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.281; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.285; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.286; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.290; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.291; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.295; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.296; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.300; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.301; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.392; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.395; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:48479
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.396; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.396; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.397; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1366381759306
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.397; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1366381759306/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.398; org.apache.solr.core.CoreContainer; New CoreContainer 5274031
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.398; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1366381759306/'
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.398; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1366381759306/'
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.491; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.492; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.492; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.493; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.493; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.494; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.494; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.494; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.495; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.495; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.498; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.499; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:52732/solr
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.499; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.500; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.502; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@638df7 name:ZooKeeperConnection Watcher:127.0.0.1:52732 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.502; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.504; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.507; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.509; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@4bfbef name:ZooKeeperConnection Watcher:127.0.0.1:52732/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.509; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.511; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.514; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/collection-queue-work
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.517; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.519; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48479_vf%2Fg
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.520; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:48479_vf%2Fg
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.523; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/election
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.528; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.532; org.apache.solr.cloud.Overseer; Overseer (id=89547194963918851-127.0.0.1:48479_vf%2Fg-n_0000000000) starting
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.537; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue-work
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.542; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.542; org.apache.solr.common.cloud.SolrZkClient; makePath: /clusterstate.json
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.545; org.apache.solr.common.cloud.SolrZkClient; makePath: /aliases.json
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.548; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.552; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.555; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.556; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.557; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.570; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.573; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.575; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@2150e2 name:ZooKeeperConnection Watcher:127.0.0.1:52732/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.575; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.577; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.580; org.apache.solr.cloud.ChaosMonkey; monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.651; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.653; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:50347
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.654; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.654; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.655; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1366381759581
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.655; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1366381759581/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.655; org.apache.solr.core.CoreContainer; New CoreContainer 10543024
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.656; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1366381759581/'
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.656; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1366381759581/'
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.749; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.750; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.750; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.751; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.751; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.751; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.752; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.752; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.753; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.753; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.756; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.756; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:52732/solr
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.757; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.758; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.759; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1cd6cb1 name:ZooKeeperConnection Watcher:127.0.0.1:52732 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.760; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.762; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.765; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.766; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@17591b name:ZooKeeperConnection Watcher:127.0.0.1:52732/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.766; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:19.769; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.773; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50347_vf%2Fg
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.775; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:50347_vf%2Fg
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.780; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.780; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.780; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.788; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.789; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.790; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.859; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.861; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:41134
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.861; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.862; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.862; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1366381760795
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.863; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1366381760795/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.863; org.apache.solr.core.CoreContainer; New CoreContainer 11155412
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.864; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1366381760795/'
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.864; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1366381760795/'
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.962; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.963; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.963; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.964; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.964; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.965; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.965; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.965; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.966; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.966; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.970; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.970; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:52732/solr
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.971; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.972; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.973; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@889b3f name:ZooKeeperConnection Watcher:127.0.0.1:52732 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.974; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.975; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.978; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.980; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@12675ec name:ZooKeeperConnection Watcher:127.0.0.1:52732/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.980; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:20.985; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:21.989; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41134_vf%2Fg
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:21.991; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:41134_vf%2Fg
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:21.996; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:21.996; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:21.996; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:21.996; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.003; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.004; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.005; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.089; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.091; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:41445
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.091; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.092; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.092; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1366381762010
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.093; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1366381762010/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.093; org.apache.solr.core.CoreContainer; New CoreContainer 9525018
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.094; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1366381762010/'
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.094; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1366381762010/'
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.183; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.183; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.184; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.184; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.184; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.185; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.185; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.186; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.186; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.186; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.189; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.190; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:52732/solr
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.190; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.191; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.192; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@dfb9eb name:ZooKeeperConnection Watcher:127.0.0.1:52732 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.193; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.194; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.197; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.198; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1f5a39 name:ZooKeeperConnection Watcher:127.0.0.1:52732/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.198; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:22.201; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.204; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41445_vf%2Fg
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.206; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:41445_vf%2Fg
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.210; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.210; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.211; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.210; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.210; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.218; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.218; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.219; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.309; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.311; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:35607
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.311; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.312; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.312; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1366381763224
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.313; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1366381763224/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.313; org.apache.solr.core.CoreContainer; New CoreContainer 26730551
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.314; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1366381763224/'
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.314; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1366381763224/'
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.401; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.402; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.402; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.403; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.403; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.404; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.404; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.404; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.405; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.405; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.408; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.409; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:52732/solr
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.409; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.410; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.411; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1fb869b name:ZooKeeperConnection Watcher:127.0.0.1:52732 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.411; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.413; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.416; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.417; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@6922e4 name:ZooKeeperConnection Watcher:127.0.0.1:52732/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.417; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:23.420; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.423; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35607_vf%2Fg
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.426; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:35607_vf%2Fg
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.432; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.432; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.432; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.432; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.432; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.432; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.440; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.441; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.442; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.445; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.449; org.apache.solr.core.CoreContainer; Creating SolrCore 'unloadcollection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1366381759581/unloadcollection1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.449; org.apache.solr.cloud.ZkController; Check for collection zkNode:unloadcollection
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.451; org.apache.solr.cloud.ZkController; Creating collection in ZooKeeper:unloadcollection
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.451; org.apache.solr.cloud.ZkController; Looking for collection configName
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.454; org.apache.solr.cloud.ZkController; Only one config set found in zk - using it:conf1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.454; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/unloadcollection
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.457; org.apache.solr.cloud.ZkController; Load collection config from:/collections/unloadcollection
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.459; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1366381759581/unloadcollection1/'
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.497; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.548; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.549; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.554; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.986; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.992; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:24.995; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.005; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.010; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.015; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 14:29:25.017; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 14:29:25.018; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.018; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 14:29:25.020; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 14:29:25.020; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.021; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.021; org.apache.solr.core.SolrCore; [unloadcollection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1366381759581/unloadcollection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381764447unloadcollection1_1n/
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.022; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@14f7b17
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.023; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.024; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381764447unloadcollection1_1n
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.025; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381764447unloadcollection1_1n/index/
[junit4:junit4]   1> WARN  - 2013-04-19 14:29:25.026; org.apache.solr.core.SolrCore; [unloadcollection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381764447unloadcollection1_1n/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.027; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381764447unloadcollection1_1n/index
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.029; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@ccb403 lockFactory=org.apache.lucene.store.NativeFSLockFactory@bd7604),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.030; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.033; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.034; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.035; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.036; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.038; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.038; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.039; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.040; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.041; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.044; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.047; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@10b070f main
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.047; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381764447unloadcollection1_1n/tlog
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.048; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.048; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.058; org.apache.solr.core.SolrCore; [unloadcollection1] Registered new searcher Searcher@10b070f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.059; org.apache.solr.cloud.ZkController; publishing core=unloadcollection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.563; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.565; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"unloadcollection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:50347/vf/g",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:50347_vf%2Fg",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core":"unloadcollection1"}
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.565; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection unloadcollection with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.566; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.574; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.574; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.574; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.574; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.574; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:25.575; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:26.060; org.apache.solr.core.CoreContainer; registering core: unloadcollection1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:26.061; org.apache.solr.cloud.ZkController; Register replica - core:unloadcollection1 address:http://127.0.0.1:50347/vf/g collection:unloadcollection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:26.063; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/unloadcollection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:26.072; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:26.076; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:26.077; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:26.077; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:50347/vf/g/unloadcollection1/
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:26.078; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:26.079; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:50347/vf/g/unloadcollection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:26.079; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:50347/vf/g/unloadcollection1/
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:26.080; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/unloadcollection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.081; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.093; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.093; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.093; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.093; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.093; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.093; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.141; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:50347/vf/g/unloadcollection1/ and leader is http://127.0.0.1:50347/vf/g/unloadcollection1/
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.142; org.apache.solr.cloud.ZkController; No LogReplay needed for core=unloadcollection1 baseURL=http://127.0.0.1:50347/vf/g
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.143; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.143; org.apache.solr.cloud.ZkController; publishing core=unloadcollection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.147; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.148; org.apache.solr.core.CoreContainer; Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1366381759581/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.149; org.apache.solr.core.SolrXMLSerializer; Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1366381759581/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.151; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={collection=unloadcollection&wt=javabin&action=CREATE&version=2&numShards=1&name=unloadcollection1&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381764447unloadcollection1_1n} status=0 QTime=2702 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.152; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.155; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.158; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@119047d name:ZooKeeperConnection Watcher:127.0.0.1:52732/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.158; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.161; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.165; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.167; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.174; org.apache.solr.core.CoreContainer; Creating SolrCore 'unloadcollection2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1366381760795/unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.175; org.apache.solr.cloud.ZkController; Check for collection zkNode:unloadcollection
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.177; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.177; org.apache.solr.cloud.ZkController; Load collection config from:/collections/unloadcollection
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.180; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1366381760795/unloadcollection2/'
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.224; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.268; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.270; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.274; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.720; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.726; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.729; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.742; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.747; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.753; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 14:29:27.754; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 14:29:27.755; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.756; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 14:29:27.757; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 14:29:27.758; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.759; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.759; org.apache.solr.core.SolrCore; [unloadcollection2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1366381760795/unloadcollection2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381767173unloadcollection1_2n/
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.760; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@14f7b17
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.761; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.762; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381767173unloadcollection1_2n
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.763; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381767173unloadcollection1_2n/index/
[junit4:junit4]   1> WARN  - 2013-04-19 14:29:27.763; org.apache.solr.core.SolrCore; [unloadcollection2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381767173unloadcollection1_2n/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.764; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381767173unloadcollection1_2n/index
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.765; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@18f5dff lockFactory=org.apache.lucene.store.NativeFSLockFactory@12a000a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.765; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.767; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.767; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.768; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.769; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.769; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.769; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.770; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.770; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.771; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.773; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.776; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@186938a main
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.776; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381767173unloadcollection1_2n/tlog
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.777; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.777; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.781; org.apache.solr.core.SolrCore; [unloadcollection2] Registered new searcher Searcher@186938a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.783; org.apache.solr.cloud.ZkController; publishing core=unloadcollection2 state=down
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:27.784; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.601; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.602; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"unloadcollection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:50347/vf/g",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:50347_vf%2Fg",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:50347_vf%2Fg_unloadcollection1",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "core":"unloadcollection1"}
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.605; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"unloadcollection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:41134/vf/g",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:41134_vf%2Fg",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core":"unloadcollection2"}
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.605; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.605; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.608; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.608; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.608; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.608; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.608; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.608; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.609; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.785; org.apache.solr.core.CoreContainer; registering core: unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.786; org.apache.solr.cloud.ZkController; Register replica - core:unloadcollection2 address:http://127.0.0.1:41134/vf/g collection:unloadcollection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.789; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:41134/vf/g/unloadcollection2/ and leader is http://127.0.0.1:50347/vf/g/unloadcollection1/
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.789; org.apache.solr.cloud.ZkController; No LogReplay needed for core=unloadcollection2 baseURL=http://127.0.0.1:41134/vf/g
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.789; org.apache.solr.cloud.ZkController; Core needs to recover:unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.790; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.790; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=unloadcollection2 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.791; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.791; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.791; org.apache.solr.cloud.ZkController; publishing core=unloadcollection2 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.792; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.792; org.apache.solr.core.CoreContainer; Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1366381760795/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.792; org.apache.solr.core.SolrXMLSerializer; Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1366381760795/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.793; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.793; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={collection=unloadcollection&wt=javabin&action=CREATE&version=2&name=unloadcollection2&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381767173unloadcollection1_2n} status=0 QTime=1619 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.794; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.795; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.796; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:28.797; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:41134_vf%2Fg_unloadcollection2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:29.798; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:30.115; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:30.116; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"unloadcollection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:41134/vf/g",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:41134_vf%2Fg",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:41134_vf%2Fg_unloadcollection2",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "core":"unloadcollection2"}
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:30.143; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:30.144; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:30.144; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:30.143; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:30.143; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:30.143; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:30.144; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:30.797; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:41134_vf%2Fg_unloadcollection2, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:30.798; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={wt=javabin&onlyIfLeader=true&coreNodeName=127.0.0.1:41134_vf%252Fg_unloadcollection2&nodeName=127.0.0.1:41134_vf%252Fg&action=PREPRECOVERY&version=2&checkLive=true&state=recovering&core=unloadcollection1} status=0 QTime=2002 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:30.799; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:31.801; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.799; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:50347/vf/g/unloadcollection1/ core=unloadcollection2 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.799; org.apache.solr.update.PeerSync; PeerSync: core=unloadcollection2 url=http://127.0.0.1:41134/vf/g START replicas=[http://127.0.0.1:50347/vf/g/unloadcollection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-19 14:29:32.800; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.800; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.800; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.800; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.800; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.801; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:50347/vf/g/unloadcollection1/. core=unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.801; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.804; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.805; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/vf/g path=/get params={qt=/get&wt=javabin&version=2&getVersions=100&distrib=false} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.808; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.809; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@ccb403 lockFactory=org.apache.lucene.store.NativeFSLockFactory@bd7604),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.809; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.809; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@ccb403 lockFactory=org.apache.lucene.store.NativeFSLockFactory@bd7604),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@ccb403 lockFactory=org.apache.lucene.store.NativeFSLockFactory@bd7604),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.810; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.810; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@118d5c3 realtime
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.811; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.811; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={softCommit=false&commit_end_point=true&wt=javabin&version=2&openSearcher=false&waitSearcher=true&commit=true} {commit=} 0 3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.812; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.812; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.815; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.816; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/vf/g path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=3 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.816; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.816; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.816; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.818; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/vf/g path=/replication params={qt=/replication&wt=javabin&generation=2&version=2&command=filelist} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.819; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.819; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381767173unloadcollection1_2n/index.20130419092932819
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.819; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@10f0690 lockFactory=org.apache.lucene.store.NativeFSLockFactory@cda90d) fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.821; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/vf/g path=/replication params={qt=/replication&file=segments_2&wt=filestream&checksum=true&generation=2&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.828; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.829; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.829; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.830; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@18f5dff lockFactory=org.apache.lucene.store.NativeFSLockFactory@12a000a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@18f5dff lockFactory=org.apache.lucene.store.NativeFSLockFactory@12a000a),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.830; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.830; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.831; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@3e40af main
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.832; org.apache.solr.core.SolrCore; [unloadcollection2] Registered new searcher Searcher@3e40af main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.832; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381767173unloadcollection1_2n/index.20130419092932819 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381767173unloadcollection1_2n/index.20130419092932819;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.832; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381767173unloadcollection1_2n/index.20130419092932819
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.833; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381767173unloadcollection1_2n/index.20130419092932819
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.833; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.833; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.833; org.apache.solr.cloud.ZkController; publishing core=unloadcollection2 state=active
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.834; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:32.834; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.150; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.151; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"unloadcollection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:41134/vf/g",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:41134_vf%2Fg",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:41134_vf%2Fg_unloadcollection2",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "core":"unloadcollection2"}
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.155; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.155; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.155; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.155; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.155; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.155; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.155; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.805; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.806; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished - collection: unloadcollection
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.807; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.817; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1432755134854594560)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.818; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[6 (1432755134854594560)]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.822; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1432755134865080320)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.823; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[7 (1432755134865080320)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.828; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1432755134870323200)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.828; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[8 (1432755134870323200)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.830; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.833; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@ccb403 lockFactory=org.apache.lucene.store.NativeFSLockFactory@bd7604),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@ccb403 lockFactory=org.apache.lucene.store.NativeFSLockFactory@bd7604),segFN=segments_3,generation=3,filenames=[_0_Lucene40_0.tim, _0_Lucene40_0.frq, _0.fdx, _0.fnm, segments_3, _0_nrm.cfe, _0_Lucene40_0.tip, _0_dv.cfe, _0_Lucene40_0.prx, _0.fdt, _0.si, _0_dv.cfs, _0_nrm.cfs]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.834; org.apache.solr.core.SolrDeletionPolicy; newest commit = 3[_0_Lucene40_0.tim, _0_Lucene40_0.frq, _0.fdx, _0.fnm, segments_3, _0_nrm.cfe, _0_Lucene40_0.tip, _0_dv.cfe, _0_Lucene40_0.prx, _0.fdt, _0.si, _0_dv.cfs, _0_nrm.cfs]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.835; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@b66eb2 main
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.836; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.836; org.apache.solr.core.SolrCore; [unloadcollection1] Registered new searcher Searcher@b66eb2 main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C3)}
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.837; org.apache.solr.update.SolrCmdDistributor; Distrib commit to:[StdNode: http://127.0.0.1:41134/vf/g/unloadcollection2/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.839; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.841; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@18f5dff lockFactory=org.apache.lucene.store.NativeFSLockFactory@12a000a),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@18f5dff lockFactory=org.apache.lucene.store.NativeFSLockFactory@12a000a),segFN=segments_3,generation=3,filenames=[_0_Lucene40_0.tim, _0_Lucene40_0.frq, _0.fdx, _0.fnm, segments_3, _0_nrm.cfe, _0_Lucene40_0.tip, _0_dv.cfe, _0_Lucene40_0.prx, _0.fdt, _0.si, _0_dv.cfs, _0_nrm.cfs]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.842; org.apache.solr.core.SolrDeletionPolicy; newest commit = 3[_0_Lucene40_0.tim, _0_Lucene40_0.frq, _0.fdx, _0.fnm, segments_3, _0_nrm.cfe, _0_Lucene40_0.tip, _0_dv.cfe, _0_Lucene40_0.prx, _0.fdt, _0.si, _0_dv.cfs, _0_nrm.cfs]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.843; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@19a6be1 main
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.844; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.845; org.apache.solr.core.SolrCore; [unloadcollection2] Registered new searcher Searcher@19a6be1 main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C3)}
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.845; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={softCommit=false&commit_end_point=true&wt=javabin&expungeDeletes=false&version=2&waitSearcher=true&commit=true} {commit=} 0 6
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.846; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={softCommit=false&wt=javabin&version=2&waitSearcher=true&commit=true} {commit=} 0 16
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.846; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.850; org.apache.solr.core.CoreContainer; Creating SolrCore 'unloadcollection3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1366381762010/unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.850; org.apache.solr.cloud.ZkController; Check for collection zkNode:unloadcollection
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.851; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.851; org.apache.solr.cloud.ZkController; Load collection config from:/collections/unloadcollection
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.853; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1366381762010/unloadcollection3/'
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.883; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.928; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.929; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:33.934; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.366; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.372; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.375; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.384; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.387; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.390; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 14:29:34.391; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 14:29:34.391; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.392; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 14:29:34.393; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 14:29:34.393; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.393; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.394; org.apache.solr.core.SolrCore; [unloadcollection3] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1366381762010/unloadcollection3/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381773849unloadcollection_3n/
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.394; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@14f7b17
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.394; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.395; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381773849unloadcollection_3n
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.396; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381773849unloadcollection_3n/index/
[junit4:junit4]   1> WARN  - 2013-04-19 14:29:34.396; org.apache.solr.core.SolrCore; [unloadcollection3] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381773849unloadcollection_3n/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.396; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381773849unloadcollection_3n/index
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.398; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@12d9e6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@12a9467),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.398; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.400; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.400; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.401; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.401; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.402; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.402; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.402; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.403; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.403; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.406; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.409; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@28bd67 main
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.409; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381773849unloadcollection_3n/tlog
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.410; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.410; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.413; org.apache.solr.core.SolrCore; [unloadcollection3] Registered new searcher Searcher@28bd67 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.414; org.apache.solr.cloud.ZkController; publishing core=unloadcollection3 state=down
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.414; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.661; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.662; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"unloadcollection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:41445/vf/g",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:41445_vf%2Fg",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core":"unloadcollection3"}
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.662; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.662; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.667; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.668; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.667; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.667; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.667; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.667; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:34.667; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:35.416; org.apache.solr.core.CoreContainer; registering core: unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:35.416; org.apache.solr.cloud.ZkController; Register replica - core:unloadcollection3 address:http://127.0.0.1:41445/vf/g collection:unloadcollection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:35.420; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:41445/vf/g/unloadcollection3/ and leader is http://127.0.0.1:50347/vf/g/unloadcollection1/
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:35.420; org.apache.solr.cloud.ZkController; No LogReplay needed for core=unloadcollection3 baseURL=http://127.0.0.1:41445/vf/g
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:35.421; org.apache.solr.cloud.ZkController; Core needs to recover:unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:35.421; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:35.421; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=unloadcollection3 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:35.423; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:35.423; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:35.423; org.apache.solr.cloud.ZkController; publishing core=unloadcollection3 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:35.423; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:35.424; org.apache.solr.core.CoreContainer; Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1366381762010/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:35.424; org.apache.solr.core.SolrXMLSerializer; Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1366381762010/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:35.424; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:35.425; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={collection=unloadcollection&wt=javabin&action=CREATE&version=2&name=unloadcollection3&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381773849unloadcollection_3n} status=0 QTime=1575 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:35.426; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:35.426; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:35.428; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:41445_vf%2Fg_unloadcollection3, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:36.172; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:36.173; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"unloadcollection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:41445/vf/g",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:41445_vf%2Fg",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:41445_vf%2Fg_unloadcollection3",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "core":"unloadcollection3"}
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:36.176; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:36.176; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:36.176; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:36.176; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:36.176; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:36.176; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:36.177; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:36.428; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:36.429; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:41445_vf%2Fg_unloadcollection3, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:36.430; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={wt=javabin&onlyIfLeader=true&coreNodeName=127.0.0.1:41445_vf%252Fg_unloadcollection3&nodeName=127.0.0.1:41445_vf%252Fg&action=PREPRECOVERY&version=2&checkLive=true&state=recovering&core=unloadcollection1} status=0 QTime=1002 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:37.430; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.430; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:50347/vf/g/unloadcollection1/ core=unloadcollection3 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.431; org.apache.solr.update.PeerSync; PeerSync: core=unloadcollection3 url=http://127.0.0.1:41445/vf/g START replicas=[http://127.0.0.1:50347/vf/g/unloadcollection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-19 14:29:38.431; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.431; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.432; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.432; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.432; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.433; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.433; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:50347/vf/g/unloadcollection1/. core=unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.433; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/vf/g path=/get params={qt=/get&wt=javabin&version=2&getVersions=100&distrib=false} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.433; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.442; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.443; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@ccb403 lockFactory=org.apache.lucene.store.NativeFSLockFactory@bd7604),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@ccb403 lockFactory=org.apache.lucene.store.NativeFSLockFactory@bd7604),segFN=segments_3,generation=3,filenames=[_0_Lucene40_0.tim, _0_Lucene40_0.frq, _0.fdx, _0.fnm, segments_3, _0_nrm.cfe, _0_Lucene40_0.tip, _0_dv.cfe, _0_Lucene40_0.prx, _0.fdt, _0.si, _0_dv.cfs, _0_nrm.cfs]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@ccb403 lockFactory=org.apache.lucene.store.NativeFSLockFactory@bd7604),segFN=segments_4,generation=4,filenames=[_0_Lucene40_0.tim, segments_4, _0_Lucene40_0.frq, _0.fdx, _0.fnm, _0_nrm.cfe, _0_Lucene40_0.tip, _0_dv.cfe, _0_Lucene40_0.prx, _0.fdt, _0.si, _0_dv.cfs, _0_nrm.cfs]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.444; org.apache.solr.core.SolrDeletionPolicy; newest commit = 4[_0_Lucene40_0.tim, segments_4, _0_Lucene40_0.frq, _0.fdx, _0.fnm, _0_nrm.cfe, _0_Lucene40_0.tip, _0_dv.cfe, _0_Lucene40_0.prx, _0.fdt, _0.si, _0_dv.cfs, _0_nrm.cfs]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.444; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.444; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={softCommit=false&commit_end_point=true&wt=javabin&version=2&openSearcher=false&waitSearcher=true&commit=true} {commit=} 0 2
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.445; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.445; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.447; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/vf/g path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.448; org.apache.solr.handler.SnapPuller; Master's generation: 4
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.448; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.448; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.450; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/vf/g path=/replication params={qt=/replication&wt=javabin&generation=4&version=2&command=filelist} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.450; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 13
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.451; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381773849unloadcollection_3n/index.20130419092938450
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.451; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@341317 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e0e394) fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.453; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/vf/g path=/replication params={qt=/replication&file=_0_Lucene40_0.tip&wt=filestream&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.455; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/vf/g path=/replication params={qt=/replication&file=_0_Lucene40_0.prx&wt=filestream&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.458; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/vf/g path=/replication params={qt=/replication&file=segments_4&wt=filestream&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.461; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/vf/g path=/replication params={qt=/replication&file=_0_Lucene40_0.tim&wt=filestream&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.463; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/vf/g path=/replication params={qt=/replication&file=_0_Lucene40_0.frq&wt=filestream&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.465; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/vf/g path=/replication params={qt=/replication&file=_0.fnm&wt=filestream&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.468; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/vf/g path=/replication params={qt=/replication&file=_0.fdx&wt=filestream&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.470; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/vf/g path=/replication params={qt=/replication&file=_0_nrm.cfe&wt=filestream&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.473; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/vf/g path=/replication params={qt=/replication&file=_0_dv.cfe&wt=filestream&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.475; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/vf/g path=/replication params={qt=/replication&file=_0.fdt&wt=filestream&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.478; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/vf/g path=/replication params={qt=/replication&file=_0_dv.cfs&wt=filestream&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.480; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/vf/g path=/replication params={qt=/replication&file=_0.si&wt=filestream&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.483; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/vf/g path=/replication params={qt=/replication&file=_0_nrm.cfs&wt=filestream&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.483; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.484; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.484; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.485; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@12d9e6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@12a9467),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@12d9e6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@12a9467),segFN=segments_4,generation=4,filenames=[_0_Lucene40_0.tim, segments_4, _0_Lucene40_0.frq, _0.fnm, _0.fdx, _0_nrm.cfe, _0_Lucene40_0.tip, _0_dv.cfe, _0_Lucene40_0.prx, _0.fdt, _0_dv.cfs, _0.si, _0_nrm.cfs]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.486; org.apache.solr.core.SolrDeletionPolicy; newest commit = 4[_0_Lucene40_0.tim, segments_4, _0_Lucene40_0.frq, _0.fnm, _0.fdx, _0_nrm.cfe, _0_Lucene40_0.tip, _0_dv.cfe, _0_Lucene40_0.prx, _0.fdt, _0_dv.cfs, _0.si, _0_nrm.cfs]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.486; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.487; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@d54742 main
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.487; org.apache.solr.core.SolrCore; [unloadcollection3] Registered new searcher Searcher@d54742 main{StandardDirectoryReader(segments_4:3:nrt _0(5.0):C3)}
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.488; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381773849unloadcollection_3n/index.20130419092938450 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381773849unloadcollection_3n/index.20130419092938450;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.488; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381773849unloadcollection_3n/index.20130419092938450
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.489; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381773849unloadcollection_3n/index.20130419092938450
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.489; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.489; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.489; org.apache.solr.cloud.ZkController; publishing core=unloadcollection3 state=active
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.489; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:38.501; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.181; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.182; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"unloadcollection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:41445/vf/g",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:41445_vf%2Fg",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:41445_vf%2Fg_unloadcollection3",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "core":"unloadcollection3"}
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.185; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.186; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.186; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.186; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.186; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.185; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.185; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.433; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.435; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished - collection: unloadcollection
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.436; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.470; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[20 (1432755140782194688)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.470; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[20 (1432755140782194688)]} 0 2
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.471; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[20 (1432755140782194688)]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.473; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[20]} 0 13
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.481; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[21 (1432755140796874752)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.481; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[21 (1432755140796874752)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.482; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[21 (1432755140796874752)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.483; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[21]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.491; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[22 (1432755140807360512)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.491; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[22 (1432755140807360512)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.493; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[22 (1432755140807360512)]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.494; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[22]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.502; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[23 (1432755140818894848)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.502; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[23 (1432755140818894848)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.504; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[23 (1432755140818894848)]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.504; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[23]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.513; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[24 (1432755140830429184)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.513; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[24 (1432755140830429184)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.515; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[24 (1432755140830429184)]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.516; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[24]} 0 9
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.524; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[25 (1432755140841963520)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.524; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[25 (1432755140841963520)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.525; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[25 (1432755140841963520)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.526; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[25]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.533; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[26 (1432755140852449280)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.533; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[26 (1432755140852449280)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.535; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[26 (1432755140852449280)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.536; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[26]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.544; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[27 (1432755140863983616)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.544; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[27 (1432755140863983616)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.546; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[27 (1432755140863983616)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.547; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[27]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.554; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[28 (1432755140874469376)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.554; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[28 (1432755140874469376)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.556; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[28 (1432755140874469376)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.556; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[28]} 0 7
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.563; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[29 (1432755140884955136)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.563; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[29 (1432755140884955136)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.564; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[29 (1432755140884955136)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.565; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[29]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.570; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[30 (1432755140892295168)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.570; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[30 (1432755140892295168)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.571; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[30 (1432755140892295168)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.571; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[30]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.577; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[31 (1432755140899635200)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.577; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[31 (1432755140899635200)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.578; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[31 (1432755140899635200)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.578; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[31]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.583; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[32 (1432755140905926656)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.583; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[32 (1432755140905926656)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.584; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[32 (1432755140905926656)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.585; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[32]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.590; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[33 (1432755140913266688)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.590; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[33 (1432755140913266688)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.591; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[33 (1432755140913266688)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.591; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[33]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.597; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[34 (1432755140920606720)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.598; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[34 (1432755140920606720)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.599; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[34 (1432755140920606720)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.599; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[34]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.605; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[35 (1432755140928995328)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.605; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[35 (1432755140928995328)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.606; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[35 (1432755140928995328)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.606; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[35]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.612; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[36 (1432755140936335360)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.612; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[36 (1432755140936335360)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.613; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[36 (1432755140936335360)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.614; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[36]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.620; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[37 (1432755140943675392)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.620; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[37 (1432755140943675392)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.621; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[37 (1432755140943675392)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.622; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[37]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.628; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[38 (1432755140953112576)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.628; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[38 (1432755140953112576)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.629; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[38 (1432755140953112576)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.630; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[38]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.636; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[39 (1432755140960452608)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.636; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[39 (1432755140960452608)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.637; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[39 (1432755140960452608)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.638; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[39]} 0 7
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.644; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[40 (1432755140968841216)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.644; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[40 (1432755140968841216)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.645; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[40 (1432755140968841216)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.645; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[40]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.651; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[41 (1432755140976181248)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.651; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[41 (1432755140976181248)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.651; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[41 (1432755140976181248)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.652; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[41]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.658; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[42 (1432755140983521280)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.658; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[42 (1432755140983521280)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.659; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[42 (1432755140983521280)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.660; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[42]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.667; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[43 (1432755140992958464)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.667; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[43 (1432755140992958464)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.669; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[43 (1432755140992958464)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.670; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[43]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.677; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[44 (1432755141003444224)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.677; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[44 (1432755141003444224)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.679; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[44 (1432755141003444224)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.679; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[44]} 0 7
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.686; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[45 (1432755141013929984)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.686; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[45 (1432755141013929984)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.687; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[45 (1432755141013929984)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.687; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[45]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.693; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[46 (1432755141020221440)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.693; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[46 (1432755141020221440)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.693; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[46 (1432755141020221440)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.694; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[46]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.700; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[47 (1432755141027561472)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.700; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[47 (1432755141027561472)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.701; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[47 (1432755141027561472)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.702; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[47]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.709; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[48 (1432755141036998656)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.709; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[48 (1432755141036998656)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.710; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[48 (1432755141036998656)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.711; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[48]} 0 7
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.718; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[49 (1432755141046435840)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.718; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[49 (1432755141046435840)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.720; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[49 (1432755141046435840)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.720; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[49]} 0 7
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.728; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[50 (1432755141056921600)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.728; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[50 (1432755141056921600)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.730; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[50 (1432755141056921600)]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.730; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[50]} 0 7
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.738; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[51 (1432755141067407360)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.738; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[51 (1432755141067407360)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.739; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[51 (1432755141067407360)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.741; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[51]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.748; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[52 (1432755141077893120)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.748; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[52 (1432755141077893120)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.750; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[52 (1432755141077893120)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.751; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[52]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.758; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[53 (1432755141088378880)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.758; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[53 (1432755141088378880)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.760; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[53 (1432755141088378880)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.761; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[53]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.767; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[54 (1432755141098864640)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.767; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[54 (1432755141098864640)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.768; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[54 (1432755141098864640)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.768; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[54]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.774; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[55 (1432755141105156096)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.774; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[55 (1432755141105156096)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.775; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[55 (1432755141105156096)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.775; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[55]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.781; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[56 (1432755141113544704)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.781; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[56 (1432755141113544704)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.781; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[56 (1432755141113544704)]} 0 2
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.782; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[56]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.787; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[57 (1432755141119836160)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.787; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[57 (1432755141119836160)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.788; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[57 (1432755141119836160)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.789; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[57]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.794; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[58 (1432755141127176192)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.794; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[58 (1432755141127176192)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.796; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[58 (1432755141127176192)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.796; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[58]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.802; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[59 (1432755141135564800)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.802; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[59 (1432755141135564800)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.803; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[59 (1432755141135564800)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.804; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[59]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.810; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[60 (1432755141143953408)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.810; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[60 (1432755141143953408)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.812; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[60 (1432755141143953408)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.812; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[60]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.820; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[61 (1432755141153390592)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.820; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[61 (1432755141153390592)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.822; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[61 (1432755141153390592)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.823; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[61]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.830; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[62 (1432755141163876352)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.830; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[62 (1432755141163876352)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.832; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[62 (1432755141163876352)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.833; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[62]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.840; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[63 (1432755141174362112)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.841; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[63 (1432755141174362112)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.842; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[63 (1432755141174362112)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.843; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[63]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.851; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[64 (1432755141185896448)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.851; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[64 (1432755141185896448)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.852; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[64 (1432755141185896448)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.853; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[64]} 0 7
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.861; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[65 (1432755141196382208)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.861; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[65 (1432755141196382208)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.862; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[65 (1432755141196382208)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.863; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[65]} 0 7
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.871; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[66 (1432755141206867968)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.872; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[66 (1432755141206867968)]} 0 2
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.873; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[66 (1432755141206867968)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.874; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[66]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.882; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[67 (1432755141218402304)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.882; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[67 (1432755141218402304)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.883; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:41445/vf/g/unloadcollection3/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[67 (1432755141218402304)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.884; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={wt=javabin&version=2} {add=[67]} 0 7
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.890; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[68 (1432755141226790912)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-19 14:29:39.890; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/vf/g path=/update params={distrib.from=http://127.0.0.1:50347/vf/g/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=

[...truncated too long message...]

d.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.344; org.apache.solr.cloud.ZkController; publishing core=unloadcollection4 state=down
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.345; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.347; org.apache.solr.core.SolrCore; [unloadcollection4]  CLOSING SolrCore org.apache.solr.core.SolrCore@32ebc2
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.361; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=3,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.362; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.363; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.363; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.364; org.apache.solr.core.SolrCore; [unloadcollection4] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.365; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.365; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381781238unloadcollection_4n/index.20130419092953931 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381781238unloadcollection_4n/index.20130419092953931;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.366; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381781238unloadcollection_4n/index.20130419092953931
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.366; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381781238unloadcollection_4n [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381781238unloadcollection_4n;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.366; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091/1366381781238unloadcollection_4n
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.367; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89547194963918860-127.0.0.1:35607_vf%2Fg-n_0000000004) am no longer a leader.
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.368; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (0)
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.368; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 0)
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.389; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/vf/g,null}
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.442; org.apache.solr.SolrTestCaseJ4; ###Ending testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.445; org.apache.solr.cloud.ZkTestServer; connecting to 127.0.0.1:52732 52732
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.548; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@119047d name:ZooKeeperConnection Watcher:127.0.0.1:52732/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.549; org.apache.solr.common.cloud.ConnectionManager; Client->ZooKeeper status change trigger but we are already closed
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1366381759091
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=UnloadDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=E368F9F1DD4785A9 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_HN -Dtests.timezone=America/Chicago -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE  139s J0 | UnloadDistributedZkTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([E368F9F1DD4785A9:628E77E9AA18E595]:0)
[junit4:junit4]    > 	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:127)
[junit4:junit4]    > 	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:37.601; org.apache.solr.SolrTestCaseJ4; ###deleteCore
[junit4:junit4]   2> 138527 T2248 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4]   1> WARN  - 2013-04-19 14:31:38.668; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-19 14:31:38.669; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> WARN  - 2013-04-19 14:31:38.669; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=es_HN, timezone=America/Chicago
[junit4:junit4]   2> NOTE: Linux 3.2.0-40-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=1,free=68515072,total=141832192
[junit4:junit4]   2> NOTE: All tests run in this JVM: [BasicFunctionalityTest, TestCopyFieldCollectionResource, ZkCLITest, BadCopyFieldTest, ChaosMonkeyNothingIsSafeTest, UpdateRequestProcessorFactoryTest, FieldMutatingUpdateProcessorTest, SolrIndexSplitterTest, AlternateDirectoryTest, TestFieldTypeCollectionResource, MoreLikeThisHandlerTest, SliceStateTest, PeerSyncTest, TestFaceting, TestFunctionQuery, MinimalSchemaTest, SuggesterFSTTest, SoftAutoCommitTest, DateFieldTest, RecoveryZkTest, TestBadConfig, TestSweetSpotSimilarityFactory, ExternalFileFieldSortTest, PrimUtilsTest, TestRealTimeGet, RegexBoostProcessorTest, TestRemoteStreaming, QueryEqualityTest, SynonymTokenizerTest, IndexSchemaTest, MBeansHandlerTest, TestPseudoReturnFields, ResourceLoaderTest, SOLR749Test, ShardSplitTest, TestXIncludeConfig, ScriptEngineTest, TestSerializedLuceneMatchVersion, LeaderElectionTest, SystemInfoHandlerTest, TestSolrCoreProperties, PreAnalyzedFieldTest, ResponseLogComponentTest, ReturnFieldsTest, TestStressVersions, ShowFileRequestHandlerTest, TestCoreContainer, TestCloudManagedSchema, SimpleFacetsTest, CircularListTest, OverseerCollectionProcessorTest, TestTrie, RAMDirectoryFactoryTest, TestReversedWildcardFilterFactory, DistributedQueryElevationComponentTest, DistributedSpellCheckComponentTest, TestPluginEnable, ShardRoutingTest, SpellingQueryConverterTest, TestIBSimilarityFactory, TestSort, WordBreakSolrSpellCheckerTest, TestLFUCache, PluginInfoTest, PrimitiveFieldTypeTest, TestReplicationHandler, TestCharFilters, TestValueSourceCache, TestSurroundQueryParser, TestSolrQueryParserDefaultOperatorResource, UnloadDistributedZkTest]
[junit4:junit4] Completed on J0 in 139.83s, 1 test, 1 failure <<< FAILURES!

[...truncated 451 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:375: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:355: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1231: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:875: There were test failures: 290 suites, 1202 tests, 1 failure, 13 ignored (7 assumptions)

Total time: 43 minutes 49 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-ea-b84 -client -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0-ea-b84) - Build # 5243 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/5243/
Java: 32bit/jdk1.8.0-ea-b84 -client -XX:+UseG1GC

2 tests failed.
REGRESSION:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
Server at http://127.0.0.1:36379/txu/pb returned non ok status:500, message:Server Error

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:36379/txu/pb returned non ok status:500, message:Server Error
	at __randomizedtesting.SeedInfo.seed([CD867909732D297D:4C60F71104724941]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:374)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deleteCollectionWithDownNodes(CollectionsAPIDistributedZkTest.java:206)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:148)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Server at http://127.0.0.1:38168/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:38168/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
	at __randomizedtesting.SeedInfo.seed([CD867909732D297D:4C60F71104724941]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:374)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9157 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4]   1> INFO  - 2013-04-19 12:57:59.524; org.apache.solr.BaseDistributedSearchTestCase; Setting hostContext system property: /
[junit4:junit4]   1> INFO  - 2013-04-19 12:57:59.528; org.apache.solr.SolrTestCaseJ4; ###Starting testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-19 12:57:59.529; org.apache.solr.cloud.ZkTestServer; STARTING ZK TEST SERVER
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   1> INFO  - 2013-04-19 12:57:59.529; org.apache.solr.cloud.ZkTestServer$ZKServerMain; Starting server
[junit4:junit4]   1> INFO  - 2013-04-19 12:57:59.629; org.apache.solr.cloud.ZkTestServer; start zk server on port:46952
[junit4:junit4]   1> INFO  - 2013-04-19 12:57:59.637; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.172; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@15b564b name:ZooKeeperConnection Watcher:127.0.0.1:46952 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.173; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.173; org.apache.solr.common.cloud.SolrZkClient; makePath: /solr
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.177; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.178; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@19cbb90 name:ZooKeeperConnection Watcher:127.0.0.1:46952/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.179; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.179; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.181; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/shards
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.183; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.185; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/shards
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.187; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.187; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.191; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.192; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.195; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.195; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.197; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.198; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.199; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.200; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.202; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.202; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.204; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.205; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.207; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.207; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.209; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.209; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.289; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.294; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:52616
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.295; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.295; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.296; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1366376280212
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.296; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1366376280212/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.297; org.apache.solr.core.CoreContainer; New CoreContainer 17514115
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.297; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1366376280212/'
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.298; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1366376280212/'
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.422; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.423; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.424; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.424; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.424; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.425; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.425; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.426; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.426; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.427; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.431; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.431; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:46952/solr
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.432; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.432; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.434; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1d29114 name:ZooKeeperConnection Watcher:127.0.0.1:46952 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.434; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.436; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.440; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.441; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@5cc918 name:ZooKeeperConnection Watcher:127.0.0.1:46952/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.441; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.443; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.445; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/collection-queue-work
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.449; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.451; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52616_
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.452; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:52616_
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.454; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/election
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.463; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.465; org.apache.solr.cloud.Overseer; Overseer (id=89546835855409155-127.0.0.1:52616_-n_0000000000) starting
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.468; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue-work
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.471; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.473; org.apache.solr.common.cloud.SolrZkClient; makePath: /clusterstate.json
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.476; org.apache.solr.common.cloud.SolrZkClient; makePath: /aliases.json
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.479; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.484; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.495; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1366376280212/collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.503; org.apache.solr.cloud.ZkController; Check for collection zkNode:control_collection
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.514; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.514; org.apache.solr.cloud.ZkController; Load collection config from:/collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.515; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1366376280212/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.516; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1366376280212/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.516; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1366376280212/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.564; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.617; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.619; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:00.627; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.101; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.111; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.116; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.136; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.143; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.150; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:01.153; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:01.153; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.154; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:01.155; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:01.155; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.155; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.156; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1366376280212/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/control/data/
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.156; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@dbc07b
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.156; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.157; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/control/data
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.157; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/control/data/index/
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:01.157; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.158; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/control/data/index
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.164; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e1920f lockFactory=org.apache.lucene.store.NativeFSLockFactory@2853f9),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.164; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.167; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.168; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.168; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.171; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.173; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.173; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.174; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.174; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.175; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.179; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.182; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@14a1790 main
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.183; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/control/data/tlog
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.183; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.184; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.188; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.189; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:01.190; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@14a1790 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:02.007; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:02.009; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "core_node_name":"1",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "node_name":"127.0.0.1:52616_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:52616",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "core":"collection1"}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:02.009; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection control_collection with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:02.010; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:02.014; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:02.191; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:02.191; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:52616 collection:control_collection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:02.193; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:02.202; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:02.206; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:02.206; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:02.206; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:52616/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:02.207; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:02.207; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:52616/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:02.208; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:52616/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:02.208; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.519; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.537; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.568; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:52616/collection1/ and leader is http://127.0.0.1:52616/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.569; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52616
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.569; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.569; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.569; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.570; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.572; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.572; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.573; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.576; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.577; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.578; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1392ff5 name:ZooKeeperConnection Watcher:127.0.0.1:46952/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.578; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.579; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.581; org.apache.solr.cloud.ChaosMonkey; monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.638; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.640; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:33905
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.641; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.641; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.642; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366376283581
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.642; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366376283581/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.643; org.apache.solr.core.CoreContainer; New CoreContainer 8936830
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.643; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366376283581/'
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.643; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366376283581/'
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.729; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.730; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.730; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.730; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.731; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.731; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.732; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.732; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.732; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.733; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.736; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.736; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:46952/solr
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.737; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.738; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.739; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@118bba5 name:ZooKeeperConnection Watcher:127.0.0.1:46952 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.739; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.742; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.746; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.747; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@19ef8dc name:ZooKeeperConnection Watcher:127.0.0.1:46952/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.747; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:03.750; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:04.752; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33905_
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:04.754; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:33905_
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:04.756; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:04.756; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:04.756; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:04.758; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:04.761; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366376283581/collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:04.761; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:04.762; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:04.762; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:04.763; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366376283581/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:04.763; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366376283581/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:04.764; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366376283581/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:04.796; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:04.842; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:04.848; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:04.853; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.041; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.042; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "core_node_name":"1",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "node_name":"127.0.0.1:52616_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:52616",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core":"collection1"}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.045; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.045; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.045; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.306; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.313; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.316; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.327; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.330; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.334; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:05.335; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:05.336; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.336; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:05.337; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:05.337; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.338; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.338; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366376283581/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty1/
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.338; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@dbc07b
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.339; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.339; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.339; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty1/index/
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:05.340; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.340; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty1/index
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.342; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@204432 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c2edf),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.343; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.344; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.345; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.345; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.346; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.346; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.346; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.347; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.347; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.348; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.350; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.353; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@753b0b main
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.353; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty1/tlog
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.354; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.354; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.358; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@753b0b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.361; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:05.361; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:06.548; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:06.549; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"2",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "node_name":"127.0.0.1:33905_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:33905",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "core":"collection1"}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:06.549; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection collection1 with numShards 2
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:06.550; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:06.615; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:06.615; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:06.615; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:07.363; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:07.363; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:33905 collection:collection1 shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:07.364; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:07.369; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:07.371; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:07.371; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:07.371; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:33905/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:07.372; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:07.372; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:33905/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:07.372; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:33905/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:07.372; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.118; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.127; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.128; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.128; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.178; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:33905/collection1/ and leader is http://127.0.0.1:33905/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.178; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33905
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.178; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.179; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.179; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.180; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.181; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.181; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.182; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.245; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.247; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:38168
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.248; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.248; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.249; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1366376288185
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.249; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1366376288185/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.249; org.apache.solr.core.CoreContainer; New CoreContainer 8325260
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.250; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1366376288185/'
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.250; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1366376288185/'
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.367; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.367; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.368; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.368; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.368; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.369; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.369; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.370; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.370; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.370; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.373; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.374; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:46952/solr
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.374; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.375; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.377; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@385ed6 name:ZooKeeperConnection Watcher:127.0.0.1:46952 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.378; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.379; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.382; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.384; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@e41699 name:ZooKeeperConnection Watcher:127.0.0.1:46952/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.384; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:08.387; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.389; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38168_
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.391; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:38168_
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.393; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.393; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.393; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.393; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.394; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.395; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.395; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.400; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1366376288185/collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.401; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.401; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.401; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.402; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1366376288185/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.403; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1366376288185/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.403; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1366376288185/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.436; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.479; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.481; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.485; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.633; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.633; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"2",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "node_name":"127.0.0.1:33905_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:33905",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "core":"collection1"}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.636; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.636; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.636; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.637; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.905; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.911; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.914; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.924; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.927; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.930; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:09.931; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:09.931; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.932; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:09.932; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:09.933; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.933; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.933; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1366376288185/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty2/
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.934; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@dbc07b
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.934; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.935; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty2
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.935; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty2/index/
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:09.935; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.935; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty2/index
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.936; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@b59eba lockFactory=org.apache.lucene.store.NativeFSLockFactory@1400620),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.937; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.938; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.939; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.939; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.940; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.940; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.941; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.941; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.942; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.942; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.945; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.948; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@a6a26f main
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.948; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty2/tlog
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.949; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.949; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.955; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@a6a26f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.958; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:09.958; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:11.142; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:11.142; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"3",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "node_name":"127.0.0.1:38168_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:38168",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "core":"collection1"}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:11.143; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:11.143; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:11.147; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:11.147; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:11.147; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:11.147; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:11.960; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:11.960; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:38168 collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:11.961; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:11.965; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:11.967; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:11.967; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:11.967; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:38168/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:11.968; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:11.968; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:38168/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:11.968; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:38168/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:11.968; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.651; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.657; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.658; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.658; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.658; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.673; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:38168/collection1/ and leader is http://127.0.0.1:38168/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.674; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38168
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.674; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.674; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.674; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.679; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.685; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.685; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.686; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.753; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.755; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:33965
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.756; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.757; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.757; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1366376292689
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.757; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1366376292689/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.758; org.apache.solr.core.CoreContainer; New CoreContainer 18836493
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.758; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1366376292689/'
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.759; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1366376292689/'
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.842; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.843; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.843; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.843; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.844; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.844; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.845; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.845; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.845; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.846; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.849; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.849; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:46952/solr
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.850; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.850; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.852; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@166a87d name:ZooKeeperConnection Watcher:127.0.0.1:46952 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.852; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.853; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.856; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.858; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@708aa1 name:ZooKeeperConnection Watcher:127.0.0.1:46952/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.858; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:12.861; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.863; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33965_
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.865; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:33965_
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.870; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.871; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.871; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.872; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.872; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.872; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.874; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.874; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.875; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.884; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1366376292689/collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.884; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.885; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.885; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.886; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1366376292689/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.887; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1366376292689/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.887; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1366376292689/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.918; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.959; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.960; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:13.965; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.162; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.163; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"3",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "node_name":"127.0.0.1:38168_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:38168",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core":"collection1"}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.166; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.166; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.166; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.166; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.166; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.379; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.385; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.388; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.397; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.401; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.404; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:14.405; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:14.406; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.406; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:14.407; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:14.407; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.408; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.408; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1366376292689/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty3/
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.408; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@dbc07b
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.409; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.409; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty3
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.409; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty3/index/
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:14.410; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.410; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty3/index
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.411; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1307b76 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5c229f),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.411; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.413; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.413; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.414; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.415; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.415; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.415; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.416; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.416; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.417; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.420; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.423; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@12b05c8 main
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.424; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty3/tlog
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.424; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.424; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.430; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@12b05c8 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.433; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:14.434; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:15.671; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:15.672; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"4",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "node_name":"127.0.0.1:33965_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:33965",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "core":"collection1"}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:15.673; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:15.673; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:15.680; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:15.681; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:15.681; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:15.680; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:15.680; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.435; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.435; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:33965 collection:collection1 shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.438; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:33965/collection1/ and leader is http://127.0.0.1:33905/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.438; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33965
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.438; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.439; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.439; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.440; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.440; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.440; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.440; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.441; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.441; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.441; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.442; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.445; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.513; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.515; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:51662
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.516; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.516; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.516; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1366376296445
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.517; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1366376296445/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.517; org.apache.solr.core.CoreContainer; New CoreContainer 31805642
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.518; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1366376296445/'
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.518; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1366376296445/'
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.629; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.630; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.630; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.631; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.631; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.632; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.632; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.633; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.633; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.633; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.637; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.638; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:46952/solr
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.638; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.639; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.640; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1784aa1 name:ZooKeeperConnection Watcher:127.0.0.1:46952 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.641; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.642; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.645; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.646; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@5a8bd8 name:ZooKeeperConnection Watcher:127.0.0.1:46952/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.647; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:16.649; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.186; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.188; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"4",
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "node_name":"127.0.0.1:33965_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:33965",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "core":"collection1"}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.192; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.192; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.192; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.192; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.192; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.192; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.446; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.446; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:33965_&state=recovering&version=2&wt=javabin&coreNodeName=4&action=PREPRECOVERY&checkLive=true&onlyIfLeader=true&core=collection1} status=0 QTime=1001 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.652; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51662_
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.656; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:51662_
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.658; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.658; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.658; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.658; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.659; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.658; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.659; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.659; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.660; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.661; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.661; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.661; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.665; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1366376296445/collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.666; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.666; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.667; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.667; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1366376296445/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.668; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1366376296445/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.668; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1366376296445/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.698; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.736; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.738; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:17.742; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.160; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.167; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.170; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.184; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.187; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.190; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:18.191; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:18.192; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.192; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:18.192; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:18.193; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.193; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.193; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1366376296445/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty4/
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.194; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@dbc07b
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.194; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.195; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty4
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.195; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty4/index/
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:18.195; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.195; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty4/index
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.197; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@b0ca04 lockFactory=org.apache.lucene.store.NativeFSLockFactory@106b033),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.197; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.199; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.199; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.199; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.200; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.201; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.201; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.201; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.202; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.202; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.205; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.208; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@9fc482 main
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.208; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty4/tlog
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.209; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.209; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.213; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@9fc482 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.215; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.216; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.695; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.696; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"5",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "node_name":"127.0.0.1:51662_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:51662",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "core":"collection1"}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.696; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.696; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.699; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.699; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.699; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.699; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.699; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:18.699; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.217; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.217; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:51662 collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.220; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:51662/collection1/ and leader is http://127.0.0.1:38168/collection1/
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.220; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51662
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.220; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.220; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.221; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.221; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.222; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.222; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.222; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.223; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.223; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.223; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.224; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.227; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.227; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.228; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.232; org.apache.solr.core.CoreContainer; Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366376283581/onenodecollectioncore
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.232; org.apache.solr.cloud.ZkController; Check for collection zkNode:onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.233; org.apache.solr.cloud.ZkController; Creating collection in ZooKeeper:onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.233; org.apache.solr.cloud.ZkController; Looking for collection configName
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.234; org.apache.solr.cloud.ZkController; Only one config set found in zk - using it:conf1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.235; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.236; org.apache.solr.cloud.ZkController; Load collection config from:/collections/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.237; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366376283581/onenodecollectioncore/'
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.273; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.319; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.320; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.325; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.447; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:33905/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.448; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:33965 START replicas=[http://127.0.0.1:33905/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:19.448; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.449; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.449; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.449; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.450; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.450; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:33905/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.450; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.453; org.apache.solr.core.SolrCore; [collection1] webapp= path=/get params={version=2&wt=javabin&distrib=false&qt=/get&getVersions=100} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.455; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.456; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@204432 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c2edf),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.457; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.457; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@204432 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c2edf),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@204432 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c2edf),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.458; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.458; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@ebc99 realtime
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.458; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.459; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={version=2&commit=true&wt=javabin&softCommit=false&openSearcher=false&commit_end_point=true&waitSearcher=true} {commit=} 0 4
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.460; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.460; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.464; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.464; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={version=2&command=indexversion&wt=javabin&qt=/replication} status=0 QTime=3 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.465; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.465; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.465; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.467; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={generation=2&version=2&command=filelist&wt=javabin&qt=/replication} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.467; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.468; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty3/index.20130419095819468
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.469; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@1673c34 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1639ea9) fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.471; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={generation=2&command=filecontent&file=segments_2&wt=filestream&checksum=true&qt=/replication} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.473; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.474; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.474; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.475; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1307b76 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5c229f),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1307b76 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5c229f),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.476; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.476; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.476; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1e9c47e main
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.478; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1e9c47e main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.478; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty3/index.20130419095819468 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty3/index.20130419095819468;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.478; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty3/index.20130419095819468
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.479; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty3/index.20130419095819468
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.479; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.479; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.480; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.480; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.481; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.775; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.782; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.785; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.795; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.798; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.802; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:19.803; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:19.804; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.804; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:19.805; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:19.805; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.806; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.806; org.apache.solr.core.SolrCore; [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1366376283581/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1366376279529/onenodecollection/
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.807; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@dbc07b
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.807; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.808; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1366376279529/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.808; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1366376279529/onenodecollection/index/
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:19.809; org.apache.solr.core.SolrCore; [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1366376279529/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.809; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1366376279529/onenodecollection/index
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.810; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10b6b2b lockFactory=org.apache.lucene.store.NativeFSLockFactory@c01d81),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.811; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.813; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.813; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.814; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.814; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.815; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.815; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.816; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.816; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.817; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.819; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.822; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@ed184 main
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.822; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1366376279529/onenodecollection/tlog
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.823; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.824; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.827; org.apache.solr.core.SolrCore; [onenodecollectioncore] Registered new searcher Searcher@ed184 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:19.828; org.apache.solr.cloud.ZkController; publishing core=onenodecollectioncore state=down
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.203; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.204; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"5",
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "node_name":"127.0.0.1:51662_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:51662",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core":"collection1"}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.206; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"4",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "node_name":"127.0.0.1:33965_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:33965",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "core":"collection1"}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.208; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "node_name":"127.0.0.1:33905_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:33905",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "collection":"onenodecollection",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "roles":"none",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "core":"onenodecollectioncore"}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.208; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection onenodecollection with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.209; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.215; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.215; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.215; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.215; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.215; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.215; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.228; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.228; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:51662_&state=recovering&version=2&wt=javabin&coreNodeName=5&action=PREPRECOVERY&checkLive=true&onlyIfLeader=true&core=collection1} status=0 QTime=1001 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.830; org.apache.solr.core.CoreContainer; registering core: onenodecollectioncore
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.830; org.apache.solr.cloud.ZkController; Register replica - core:onenodecollectioncore address:http://127.0.0.1:33905 collection:onenodecollection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.831; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.837; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.839; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.839; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.839; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:33905/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.840; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.840; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:33905/onenodecollectioncore/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.841; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:33905/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:20.841; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:21.720; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:21.725; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:21.725; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:21.725; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:21.725; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:21.725; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:21.725; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:21.748; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:33905/onenodecollectioncore/ and leader is http://127.0.0.1:33905/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:21.749; org.apache.solr.cloud.ZkController; No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:33905
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:21.750; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:21.750; org.apache.solr.cloud.ZkController; publishing core=onenodecollectioncore state=active
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:21.753; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:21.753; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={version=2&name=onenodecollectioncore&numShards=1&collection=onenodecollection&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1366376279529/onenodecollection&wt=javabin&roles=none&action=CREATE} status=0 QTime=2521 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:21.754; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:21.755; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.229; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:38168/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.229; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:51662 START replicas=[http://127.0.0.1:38168/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-19 12:58:22.230; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.230; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.230; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.230; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.231; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.231; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:38168/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.231; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.236; org.apache.solr.core.SolrCore; [collection1] webapp= path=/get params={version=2&wt=javabin&distrib=false&qt=/get&getVersions=100} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.238; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.239; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@b59eba lockFactory=org.apache.lucene.store.NativeFSLockFactory@1400620),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.240; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.241; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@b59eba lockFactory=org.apache.lucene.store.NativeFSLockFactory@1400620),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@b59eba lockFactory=org.apache.lucene.store.NativeFSLockFactory@1400620),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.241; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.242; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@795a0a realtime
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.242; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.242; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={version=2&commit=true&wt=javabin&softCommit=false&openSearcher=false&commit_end_point=true&waitSearcher=true} {commit=} 0 4
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.243; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.243; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.245; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.245; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={version=2&command=indexversion&wt=javabin&qt=/replication} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.245; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.246; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.246; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.247; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={generation=2&version=2&command=filelist&wt=javabin&qt=/replication} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.248; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.249; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty4/index.20130419095822248
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.249; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@70495d lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fcdfbb) fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.251; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={generation=2&command=filecontent&file=segments_2&wt=filestream&checksum=true&qt=/replication} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.252; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.253; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.254; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.254; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@b0ca04 lockFactory=org.apache.lucene.store.NativeFSLockFactory@106b033),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@b0ca04 lockFactory=org.apache.lucene.store.NativeFSLockFactory@106b033),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.255; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.255; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.255; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@f2e150 main
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.256; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@f2e150 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.257; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty4/index.20130419095822248 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty4/index.20130419095822248;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.257; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty4/index.20130419095822248
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.257; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/jetty4/index.20130419095822248
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.257; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.258; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.258; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.258; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.259; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:22.756; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:23.230; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:23.230; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:33905__onenodecollectioncore",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "node_name":"127.0.0.1:33905_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:33905",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "collection":"onenodecollection",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "roles":"none",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core":"onenodecollectioncore"}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:23.233; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"5",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "node_name":"127.0.0.1:51662_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:51662",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core":"collection1"}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:23.235; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:23.236; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:23.235; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:23.235; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:23.235; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:23.235; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:23.758; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:23.759; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished - collection: onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:23.759; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:23.765; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:23.765; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@425383 name:ZooKeeperConnection Watcher:127.0.0.1:46952 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:23.766; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> / (2)
[junit4:junit4]   1> DATA:
[junit4:junit4]   1>     
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1>  /solr (7)
[junit4:junit4]   1>   /solr/configs (1)
[junit4:junit4]   1>    /solr/configs/conf1 (9)
[junit4:junit4]   1>     /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/stopwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/old_synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/currency.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/schema.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/solrconfig.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/open-exchange-rates.json (0)
[junit4:junit4]   1>     DATA:
[junit4:junit4]   1>         {
[junit4:junit4]   1>           "disclaimer": "This data is not real, it was synthetically created to match currency.xml.  It is modeled after the data format available from openexchangerates.org.  See https://openexchangerates.org/documentation for details",
[junit4:junit4]   1>           "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4:junit4]   1>           "timestamp": 1332070464,
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "IMPORTANT NOTE": "In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "base": "USD",
[junit4:junit4]   1>           "rates": {
[junit4:junit4]   1>             "USD": 1,
[junit4:junit4]   1>             "JPY": 81.29,
[junit4:junit4]   1>             "EUR": 2.5,
[junit4:junit4]   1>             "GBP": 0.5,
[junit4:junit4]   1>             "MXN": 2.0
[junit4:junit4]   1>           }
[junit4:junit4]   1>         }
[junit4:junit4]   1>         
[junit4:junit4]   1>     /solr/configs/conf1/protwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>   /solr/live_nodes (5)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:38168_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:33905_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:51662_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:33965_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:52616_ (0)
[junit4:junit4]   1>   /solr/overseer_elect (2)
[junit4:junit4]   1>    /solr/overseer_elect/leader (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"id":"89546835855409155-127.0.0.1:52616_-n_0000000000"}
[junit4:junit4]   1>    /solr/overseer_elect/election (5)
[junit4:junit4]   1>     /solr/overseer_elect/election/89546835855409160-127.0.0.1:38168_-n_0000000002 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89546835855409164-127.0.0.1:51662_-n_0000000004 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89546835855409162-127.0.0.1:33965_-n_0000000003 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89546835855409155-127.0.0.1:52616_-n_0000000000 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89546835855409158-127.0.0.1:33905_-n_0000000001 (0)
[junit4:junit4]   1>   /solr/clusterstate.json (0)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       {
[junit4:junit4]   1>         "onenodecollection":{
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"127.0.0.1:33905__onenodecollectioncore":{
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:33905_",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:33905",
[junit4:junit4]   1>                   "collection":"onenodecollection",
[junit4:junit4]   1>                   "roles":"none",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "core":"onenodecollectioncore",
[junit4:junit4]   1>                   "leader":"true"}}}},
[junit4:junit4]   1>           "router":"compositeId"},
[junit4:junit4]   1>         "collection1":{
[junit4:junit4]   1>           "shards":{
[junit4:junit4]   1>             "shard1":{
[junit4:junit4]   1>               "range":"80000000-ffffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "3":{
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:38168_",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:38168",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "5":{
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:51662_",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:51662",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "core":"collection1"}}},
[junit4:junit4]   1>             "shard2":{
[junit4:junit4]   1>               "range":"0-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "2":{
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:33905_",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:33905",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "shard":"shard2",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "4":{
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:33965_",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:33965",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "shard":"shard2",
[junit4:junit4]   1>                   "core":"collection1"}}}},
[junit4:junit4]   1>           "router":"compositeId"},
[junit4:junit4]   1>         "control_collection":{
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"1":{
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:52616_",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:52616",
[junit4:junit4]   1>                   "collection":"control_collection",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "leader":"true"}}}},
[junit4:junit4]   1>           "router":"compositeId"}}
[junit4:junit4]   1>   /solr/overseer (3)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       
[junit4:junit4]   1>    /solr/overseer/queue (0)
[junit4:junit4]   1>    /solr/overseer/queue-work (0)
[junit4:junit4]   1>    /solr/overseer/collection-queue-work (0)
[junit4:junit4]   1>   /solr/aliases.json (0)
[junit4:junit4]   1>   /solr/collections (3)
[junit4:junit4]   1>    /solr/collections/onenodecollection (2)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {
[junit4:junit4]   1>          "configName":"conf1",
[junit4:junit4]   1>          "router":"compositeId"}
[junit4:junit4]   1>     /solr/collections/onenodecollection/leaders (1)
[junit4:junit4]   1>      /solr/collections/onenodecollection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "node_name":"127.0.0.1:33905_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:33905",
[junit4:junit4]   1>            "core":"onenodecollectioncore"}
[junit4:junit4]   1>     /solr/collections/onenodecollection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/onenodecollection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/onenodecollection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/onenodecollection/leader_elect/shard1/election/89546835855409158-127.0.0.1:33905__onenodecollectioncore-n_0000000000 (0)
[junit4:junit4]   1>    /solr/collections/collection1 (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/collection1/shards (0)
[junit4:junit4]   1>     /solr/collections/collection1/leaders (2)
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "node_name":"127.0.0.1:38168_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:38168",
[junit4:junit4]   1>            "core":"collection1"}
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard2 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "node_name":"127.0.0.1:33905_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:33905",
[junit4:junit4]   1>            "core":"collection1"}
[junit4:junit4]   1>     /solr/collections/collection1/leader_elect (2)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard1/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89546835855409164-5-n_0000000001 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89546835855409160-3-n_0000000000 (0)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard2 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard2/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89546835855409162-4-n_0000000001 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89546835855409158-2-n_0000000000 (0)
[junit4:junit4]   1>    /solr/collections/control_collection (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/control_collection/shards (0)
[junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "node_name":"127.0.0.1:52616_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:52616",
[junit4:junit4]   1>            "core":"collection1"}
[junit4:junit4]   1>     /solr/collections/control_collection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/shard1/election/89546835855409155-1-n_0000000000 (0)
[junit4:junit4]   1> 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:23.797; org.apache.solr.cloud.ChaosMonkey; monkey: stop shard! 52616
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:23.799; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=17514115
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:24.740; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:24.741; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=null message={
[junit4:junit4]   1>   "core_node_name":"1",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "node_name":"127.0.0.1:52616_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:52616",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core":"collection1"}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:24.744; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:24.744; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:24.744; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:24.744; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:24.744; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.800; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.801; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.803; org.apache.solr.core.SolrCore; [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1162749
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.807; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.808; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.808; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.808; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.809; org.apache.solr.core.SolrCore; [collection1] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.809; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.810; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/control/data [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/control/data;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.810; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/control/data
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.810; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/control/data/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/control/data/index;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.811; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1366376279528/control/data/index
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.812; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89546835855409155-127.0.0.1:52616_-n_0000000000) am no longer a leader.
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.813; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.813; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.813; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.813; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.814; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.814; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.814; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.815; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.815; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.817; org.apache.solr.cloud.Overseer; Overseer (id=89546835855409158-127.0.0.1:33905_-n_0000000001) starting
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.819; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.820; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.821; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.821; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"1",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "node_name":"127.0.0.1:52616_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:52616",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core":"collection1"}
[junit4:junit4]   1> INFO  - 2013-04-19 12:58:25.826; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, 

[...truncated too long message...]

Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1366376318107/acollectionafterbaddelete_shard1_replica1/data/index
[junit4:junit4]   1> INFO  - 2013-04-19 13:02:08.437; org.apache.solr.core.SolrCore; [halfdeletedcollection_shard1_replica1]  CLOSING SolrCore org.apache.solr.core.SolrCore@7f89
[junit4:junit4]   1> INFO  - 2013-04-19 13:02:08.443; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-19 13:02:08.443; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-19 13:02:08.443; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-19 13:02:08.444; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-19 13:02:08.445; org.apache.solr.core.SolrCore; [halfdeletedcollection_shard1_replica1] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-19 13:02:08.445; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-19 13:02:08.446; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1366376318107/halfdeletedcollection_shard1_replica1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1366376318107/halfdeletedcollection_shard1_replica1/data/index;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-19 13:02:08.446; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1366376318107/halfdeletedcollection_shard1_replica1/data/index
[junit4:junit4]   1> INFO  - 2013-04-19 13:02:08.446; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1366376318107/halfdeletedcollection_shard1_replica1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1366376318107/halfdeletedcollection_shard1_replica1/data;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-19 13:02:08.447; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1366376318107/halfdeletedcollection_shard1_replica1/data
[junit4:junit4]   1> INFO  - 2013-04-19 13:02:08.449; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89546838107553804-127.0.0.1:50314_txu%2Fpb-n_0000000004) am no longer a leader.
[junit4:junit4]   1> INFO  - 2013-04-19 13:02:08.472; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/txu/pb,null}
[junit4:junit4]   1> INFO  - 2013-04-19 13:02:08.526; org.apache.solr.SolrTestCaseJ4; ###Ending testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-19 13:02:08.530; org.apache.solr.cloud.ZkTestServer; connecting to 127.0.0.1:59667 59667
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-CollectionsAPIDistributedZkTest-1366376313894
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=CD867909732D297D -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=lt -Dtests.timezone=Pacific/Samoa -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR    215s J1 | CollectionsAPIDistributedZkTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:36379/txu/pb returned non ok status:500, message:Server Error
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([CD867909732D297D:4C60F71104724941]:0)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:374)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deleteCollectionWithDownNodes(CollectionsAPIDistributedZkTest.java:206)
[junit4:junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:148)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   1> INFO  - 2013-04-19 13:02:08.546; org.apache.solr.SolrTestCaseJ4; ###deleteCore
[junit4:junit4]   2> 214667 T1620 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4]   1> WARN  - 2013-04-19 13:02:09.750; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-19 13:02:09.750; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> WARN  - 2013-04-19 13:02:09.750; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {range_facet_l=PostingsFormat(name=Lucene41WithOrds), a_si=MockFixedIntBlock(blockSize=180), other_tl1=PostingsFormat(name=Lucene41WithOrds), id=PostingsFormat(name=MockSep), _version_=PostingsFormat(name=Lucene41WithOrds), range_facet_sl=Lucene41(blocksize=128), range_facet_si=MockFixedIntBlock(blockSize=180), timestamp=PostingsFormat(name=Lucene41WithOrds), intDefault=PostingsFormat(name=Lucene41WithOrds), text=Lucene41(blocksize=128), multiDefault=MockFixedIntBlock(blockSize=180), a_t=PostingsFormat(name=Lucene41WithOrds)}, docValues:{timestamp=DocValuesFormat(name=SimpleText)}, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=lt, timezone=Pacific/Samoa
[junit4:junit4]   2> NOTE: Linux 3.2.0-40-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=1,free=338690032,total=469762048
[junit4:junit4]   2> NOTE: All tests run in this JVM: [ConvertedLegacyTest, HighlighterConfigTest, DateMathParserTest, TestBM25SimilarityFactory, StatsComponentTest, DirectSolrSpellCheckerTest, TestSolrXMLSerializer, ZkSolrClientTest, TestCSVLoader, BadIndexSchemaTest, CopyFieldTest, DisMaxRequestHandlerTest, RequestHandlersTest, TestIndexSearcher, TestSchemaVersionResource, TestDFRSimilarityFactory, URLClassifyProcessorTest, TestZkChroot, IndexReaderFactoryTest, TestDefaultSimilarityFactory, UniqFieldsUpdateProcessorFactoryTest, TestRandomFaceting, OpenCloseCoreStressTest, ShardRoutingCustomTest, TestRangeQuery, HardAutoCommitTest, TestDynamicFieldResource, ClusterStateTest, NoCacheHeaderTest, NumericFieldsTest, SuggesterTSTTest, DocumentAnalysisRequestHandlerTest, OutputWriterTest, SpellCheckComponentTest, SolrPluginUtilsTest, TestManagedSchema, TestQueryTypes, TestStressLucene, MultiTermTest, EchoParamsTest, TestQuerySenderNoQuery, TestSchemaResource, BadCopyFieldTest, TermVectorComponentDistributedTest, TestLMJelinekMercerSimilarityFactory, TestStressReorder, XmlUpdateRequestHandlerTest, TestDynamicFieldCollectionResource, TestCodecSupport, RequiredFieldsTest, TestLuceneMatchVersion, DistanceFunctionTest, TestCSVResponseWriter, DebugComponentTest, TestFiltering, TimeZoneUtilsTest, TestNumberUtils, CoreContainerCoreInitFailuresTest, TestCollationField, TestPropInject, IndexSchemaRuntimeFieldTest, SolrIndexConfigTest, CurrencyFieldXmlFileTest, TestPartialUpdateDeduplication, TestBinaryResponseWriter, TestDistributedGrouping, StandardRequestHandlerTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest]
[junit4:junit4] Completed on J1 in 215.95s, 1 test, 1 error <<< FAILURES!

[...truncated 570 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:375: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:355: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1231: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:875: There were test failures: 290 suites, 1202 tests, 2 errors, 13 ignored (7 assumptions)

Total time: 38 minutes 40 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-ea-b84 -client -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure