You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/04/28 06:11:15 UTC

[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0-ea-b86) - Build # 5382 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/5382/
Java: 32bit/jdk1.8.0-ea-b86 -server -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch

Error Message:
Still found shard2 in collection test_unload_shard_and_collection

Stack Trace:
java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
	at __randomizedtesting.SeedInfo.seed([5F754B23DC97029E:DE93C53BABC862A2]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:127)
	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:490)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9465 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.UnloadDistributedZkTest
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.280; org.apache.solr.BaseDistributedSearchTestCase; Setting hostContext system property: /
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.284; org.apache.solr.SolrTestCaseJ4; ###Starting testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.285; org.apache.solr.cloud.ZkTestServer; STARTING ZK TEST SERVER
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.286; org.apache.solr.cloud.ZkTestServer$ZKServerMain; Starting server
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.386; org.apache.solr.cloud.ZkTestServer; start zk server on port:53839
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.387; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.433; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1927e76 name:ZooKeeperConnection Watcher:127.0.0.1:53839 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.433; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.434; org.apache.solr.common.cloud.SolrZkClient; makePath: /solr
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.438; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.439; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1558134 name:ZooKeeperConnection Watcher:127.0.0.1:53839/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.440; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.440; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.442; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/shards
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.444; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.445; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/shards
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.447; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.448; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.450; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.451; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.454; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.454; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.456; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.456; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.458; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.458; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.460; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.461; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.464; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.464; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.468; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.468; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.470; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.471; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.536; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.540; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:34572
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.540; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.541; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.541; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367121529473
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.541; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367121529473/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.542; org.apache.solr.core.CoreContainer; New CoreContainer 32697374
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.542; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367121529473/'
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.542; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367121529473/'
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.591; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367121529473
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.591; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367121529473/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.592; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367121529473/collection1/conf
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.597; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367121529473/collection1/conf/xslt
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.612; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367121529473/collection1/lib
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.613; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367121529473/collection1/lib/classes
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.614; org.apache.solr.core.SolrCoreDiscoverer; Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367121529473/conf/core.properties, adding to cores
[junit4:junit4]   1> SET INST DIR:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367121529473/conf
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.616; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.616; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.617; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.617; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.617; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.618; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.618; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.618; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.619; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.619; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.622; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.622; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:53839/solr
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.623; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.624; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.625; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1c4c46b name:ZooKeeperConnection Watcher:127.0.0.1:53839 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.625; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.627; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.630; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.631; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@8287c8 name:ZooKeeperConnection Watcher:127.0.0.1:53839/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.631; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.633; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.635; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/collection-queue-work
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.637; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.638; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34572_
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.639; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:34572_
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.641; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/election
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.645; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.647; org.apache.solr.cloud.Overseer; Overseer (id=89595676543352835-127.0.0.1:34572_-n_0000000000) starting
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.649; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue-work
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.651; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.651; org.apache.solr.common.cloud.SolrZkClient; makePath: /clusterstate.json
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.653; org.apache.solr.common.cloud.SolrZkClient; makePath: /aliases.json
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.654; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.656; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.657; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.658; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.658; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.660; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.661; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.662; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@9a90db name:ZooKeeperConnection Watcher:127.0.0.1:53839/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.662; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.664; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.665; org.apache.solr.cloud.ChaosMonkey; monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.728; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.730; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:53260
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.730; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.731; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.731; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367121529665
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.731; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367121529665/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.732; org.apache.solr.core.CoreContainer; New CoreContainer 9936684
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.732; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367121529665/'
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.733; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367121529665/'
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.778; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367121529665
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.779; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367121529665/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.780; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367121529665/collection1/conf
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.790; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367121529665/collection1/conf/xslt
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.806; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367121529665/collection1/lib
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.807; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367121529665/collection1/lib/classes
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.808; org.apache.solr.core.SolrCoreDiscoverer; Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367121529665/conf/core.properties, adding to cores
[junit4:junit4]   1> SET INST DIR:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367121529665/conf
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.810; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.810; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.811; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.811; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.811; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.812; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.812; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.812; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.813; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.813; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.816; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.816; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:53839/solr
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.817; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.817; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.819; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@41b13c name:ZooKeeperConnection Watcher:127.0.0.1:53839 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.819; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.821; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.824; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.825; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@a0acb8 name:ZooKeeperConnection Watcher:127.0.0.1:53839/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.825; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:49.828; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.830; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53260_
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.831; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:53260_
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.834; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.834; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.834; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.838; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.838; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.838; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.903; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.905; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:52032
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.905; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.906; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.906; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367121530841
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.907; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367121530841/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.907; org.apache.solr.core.CoreContainer; New CoreContainer 31999372
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.907; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367121530841/'
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.908; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367121530841/'
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.951; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367121530841
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.951; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367121530841/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.952; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367121530841/collection1/conf
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.957; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367121530841/collection1/conf/xslt
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.972; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367121530841/collection1/lib
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.973; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367121530841/collection1/lib/classes
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.974; org.apache.solr.core.SolrCoreDiscoverer; Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367121530841/conf/core.properties, adding to cores
[junit4:junit4]   1> SET INST DIR:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367121530841/conf
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.976; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.976; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.977; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.977; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.977; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.978; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.978; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.978; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.979; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.979; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.982; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.982; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:53839/solr
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.983; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.988; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.990; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@57d59b name:ZooKeeperConnection Watcher:127.0.0.1:53839 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.990; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.994; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.997; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.998; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@3eb80e name:ZooKeeperConnection Watcher:127.0.0.1:53839/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:50.998; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:51.001; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.003; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52032_
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.004; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:52032_
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.007; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.007; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.007; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.007; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.012; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.012; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.013; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.091; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.094; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:37153
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.094; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.095; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.095; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367121532016
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.096; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367121532016/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.096; org.apache.solr.core.CoreContainer; New CoreContainer 9875970
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.097; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367121532016/'
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.097; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367121532016/'
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.150; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367121532016
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.151; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367121532016/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.152; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367121532016/collection1/conf
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.159; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367121532016/collection1/conf/xslt
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.183; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367121532016/collection1/lib
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.184; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367121532016/collection1/lib/classes
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.186; org.apache.solr.core.SolrCoreDiscoverer; Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367121532016/conf/core.properties, adding to cores
[junit4:junit4]   1> SET INST DIR:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367121532016/conf
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.188; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.188; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.188; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.189; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.189; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.190; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.190; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.191; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.191; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.191; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.195; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.196; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:53839/solr
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.196; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.197; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.198; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@13bc3b6 name:ZooKeeperConnection Watcher:127.0.0.1:53839 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.198; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.200; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.203; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.205; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@15b22fb name:ZooKeeperConnection Watcher:127.0.0.1:53839/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.205; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:52.209; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.211; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37153_
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.212; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:37153_
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.215; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.215; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.215; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.215; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.216; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.224; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.224; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.224; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.289; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.292; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:47315
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.294; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.294; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.294; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367121533227
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.295; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367121533227/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.295; org.apache.solr.core.CoreContainer; New CoreContainer 9422737
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.295; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367121533227/'
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.296; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367121533227/'
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.338; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367121533227
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.339; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367121533227/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.339; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367121533227/collection1/conf
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.344; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367121533227/collection1/conf/xslt
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.359; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367121533227/collection1/lib
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.360; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367121533227/collection1/lib/classes
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.361; org.apache.solr.core.SolrCoreDiscoverer; Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367121533227/conf/core.properties, adding to cores
[junit4:junit4]   1> SET INST DIR:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367121533227/conf
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.363; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.363; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.364; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.364; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.364; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.365; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.365; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.365; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.366; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.366; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.369; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.369; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:53839/solr
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.369; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.370; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.372; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@15776a name:ZooKeeperConnection Watcher:127.0.0.1:53839 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.372; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.374; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.376; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.377; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@6e7118 name:ZooKeeperConnection Watcher:127.0.0.1:53839/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.378; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:53.381; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.383; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47315_
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.384; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:47315_
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.386; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.387; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.387; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.387; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.387; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.387; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.391; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.391; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.392; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.394; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.397; org.apache.solr.core.CoreContainer; Creating SolrCore 'unloadcollection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367121529665/unloadcollection1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.398; org.apache.solr.cloud.ZkController; Check for collection zkNode:unloadcollection
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.399; org.apache.solr.cloud.ZkController; Creating collection in ZooKeeper:unloadcollection
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.399; org.apache.solr.cloud.ZkController; Looking for collection configName
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.400; org.apache.solr.cloud.ZkController; Only one config set found in zk - using it:conf1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.401; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/unloadcollection
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.403; org.apache.solr.cloud.ZkController; Load collection config from:/collections/unloadcollection
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.404; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367121529665/unloadcollection1/'
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.446; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.487; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.488; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.492; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.895; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.900; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.902; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.912; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.915; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.918; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 03:58:54.919; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 03:58:54.920; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.920; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 03:58:54.921; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 03:58:54.922; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.922; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.922; org.apache.solr.core.SolrCore; [unloadcollection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367121529665/unloadcollection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121534396unloadcollection1_1n/
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.923; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@da6fb3
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.923; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.924; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121534396unloadcollection1_1n
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.924; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121534396unloadcollection1_1n/index/
[junit4:junit4]   1> WARN  - 2013-04-28 03:58:54.924; org.apache.solr.core.SolrCore; [unloadcollection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121534396unloadcollection1_1n/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.925; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121534396unloadcollection1_1n/index
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.926; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10c247 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c0ed0),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.926; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.928; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.928; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.929; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.929; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.930; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.930; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.930; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.931; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.931; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.934; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.936; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@14ae071 main
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.936; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121534396unloadcollection1_1n/tlog
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.937; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.937; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.940; org.apache.solr.core.SolrCore; [unloadcollection1] Registered new searcher Searcher@14ae071 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:54.941; org.apache.solr.cloud.ZkController; publishing core=unloadcollection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:55.663; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:55.664; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "collection":"unloadcollection",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "core":"unloadcollection1",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:53260",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:53260_"}
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:55.664; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection unloadcollection with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:55.664; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:55.668; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:55.668; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:55.668; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:55.668; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:55.668; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:55.668; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:55.942; org.apache.solr.core.CoreContainer; registering core: unloadcollection1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:55.942; org.apache.solr.cloud.ZkController; Register replica - core:unloadcollection1 address:http://127.0.0.1:53260 collection:unloadcollection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:55.943; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/unloadcollection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:55.948; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:55.950; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:55.950; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:55.951; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:53260/unloadcollection1/
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:55.951; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:55.951; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:53260/unloadcollection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:55.951; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:53260/unloadcollection1/
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:55.952; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/unloadcollection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.172; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.178; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.178; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.178; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.178; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.178; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.178; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.209; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:53260/unloadcollection1/ and leader is http://127.0.0.1:53260/unloadcollection1/
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.209; org.apache.solr.cloud.ZkController; No LogReplay needed for core=unloadcollection1 baseURL=http://127.0.0.1:53260
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.209; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.210; org.apache.solr.cloud.ZkController; publishing core=unloadcollection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.211; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.212; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={wt=javabin&collection=unloadcollection&name=unloadcollection1&version=2&numShards=1&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121534396unloadcollection1_1n&action=CREATE} status=0 QTime=2815 
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.213; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.214; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.216; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@f3cae5 name:ZooKeeperConnection Watcher:127.0.0.1:53839/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.216; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.217; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.219; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.219; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.227; org.apache.solr.core.CoreContainer; Creating SolrCore 'unloadcollection2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367121530841/unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.227; org.apache.solr.cloud.ZkController; Check for collection zkNode:unloadcollection
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.228; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.228; org.apache.solr.cloud.ZkController; Load collection config from:/collections/unloadcollection
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.230; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367121530841/unloadcollection2/'
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.259; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.297; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.298; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.306; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.684; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.689; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.692; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.700; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.703; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.706; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 03:58:57.707; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 03:58:57.708; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.708; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 03:58:57.709; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 03:58:57.709; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.709; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.710; org.apache.solr.core.SolrCore; [unloadcollection2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367121530841/unloadcollection2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121537226unloadcollection1_2n/
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.710; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@da6fb3
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.710; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.711; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121537226unloadcollection1_2n
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.711; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121537226unloadcollection1_2n/index/
[junit4:junit4]   1> WARN  - 2013-04-28 03:58:57.712; org.apache.solr.core.SolrCore; [unloadcollection2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121537226unloadcollection1_2n/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.712; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121537226unloadcollection1_2n/index
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.714; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@11d508d lockFactory=org.apache.lucene.store.NativeFSLockFactory@1885be),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.714; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.716; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.716; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.717; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.717; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.718; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.718; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.718; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.719; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.719; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.722; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.724; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@141f489 main
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.724; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121537226unloadcollection1_2n/tlog
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.725; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.725; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.728; org.apache.solr.core.SolrCore; [unloadcollection2] Registered new searcher Searcher@141f489 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.729; org.apache.solr.cloud.ZkController; publishing core=unloadcollection2 state=down
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:57.729; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.683; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.683; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "collection":"unloadcollection",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "core":"unloadcollection1",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:53260__unloadcollection1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:53260",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:53260_"}
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.686; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "collection":"unloadcollection",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "core":"unloadcollection2",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:52032",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:52032_"}
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.686; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.687; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.689; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.689; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.690; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.689; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.689; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.689; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.689; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.731; org.apache.solr.core.CoreContainer; registering core: unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.731; org.apache.solr.cloud.ZkController; Register replica - core:unloadcollection2 address:http://127.0.0.1:52032 collection:unloadcollection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.734; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:52032/unloadcollection2/ and leader is http://127.0.0.1:53260/unloadcollection1/
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.734; org.apache.solr.cloud.ZkController; No LogReplay needed for core=unloadcollection2 baseURL=http://127.0.0.1:52032
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.734; org.apache.solr.cloud.ZkController; Core needs to recover:unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.735; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.735; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=unloadcollection2 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.740; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.740; org.apache.solr.cloud.ZkController; publishing core=unloadcollection2 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.740; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.740; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.741; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.741; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={wt=javabin&collection=unloadcollection&name=unloadcollection2&version=2&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121537226unloadcollection1_2n&action=CREATE} status=0 QTime=1514 
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.742; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.743; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.743; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:58.745; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:52032__unloadcollection2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-28 03:58:59.745; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:00.197; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:00.198; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "collection":"unloadcollection",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "core":"unloadcollection2",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:52032__unloadcollection2",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:52032",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:52032_"}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:00.202; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:00.202; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:00.202; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:00.202; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:00.202; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:00.202; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:00.202; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:00.745; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:52032__unloadcollection2, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:00.746; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={wt=javabin&state=recovering&version=2&coreNodeName=127.0.0.1:52032__unloadcollection2&core=unloadcollection1&onlyIfLeader=true&checkLive=true&nodeName=127.0.0.1:52032_&action=PREPRECOVERY} status=0 QTime=2001 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:00.746; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:01.749; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.747; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:53260/unloadcollection1/ core=unloadcollection2 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.747; org.apache.solr.update.PeerSync; PeerSync: core=unloadcollection2 url=http://127.0.0.1:52032 START replicas=[http://127.0.0.1:53260/unloadcollection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-28 03:59:02.748; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.749; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.749; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.749; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.749; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.750; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:53260/unloadcollection1/. core=unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.750; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.750; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.756; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/get params={getVersions=100&wt=javabin&qt=/get&version=2&distrib=false} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.757; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.759; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10c247 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c0ed0),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.759; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.760; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10c247 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c0ed0),segFN=segments_1,generation=1}
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10c247 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c0ed0),segFN=segments_2,generation=2}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.760; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.761; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@9ef007 realtime
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.761; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.761; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&version=2&openSearcher=false&commit_end_point=true&softCommit=false&waitSearcher=true&commit=true} {commit=} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.762; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.762; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.764; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.765; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=javabin&qt=/replication&version=2&command=indexversion} status=0 QTime=2 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.765; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.765; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.766; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.767; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=javabin&qt=/replication&version=2&generation=2&command=filelist} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.768; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.769; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121537226unloadcollection1_2n/index.20130427225902768
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.769; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@1bfdab2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@fd6ac1) fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.771; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=segments_2&qt=/replication&checksum=true&generation=2&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.772; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.773; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.773; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.774; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@11d508d lockFactory=org.apache.lucene.store.NativeFSLockFactory@1885be),segFN=segments_1,generation=1}
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@11d508d lockFactory=org.apache.lucene.store.NativeFSLockFactory@1885be),segFN=segments_2,generation=2}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.774; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.774; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.775; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@11123ad main
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.776; org.apache.solr.core.SolrCore; [unloadcollection2] Registered new searcher Searcher@11123ad main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.776; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121537226unloadcollection1_2n/index.20130427225902768 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121537226unloadcollection1_2n/index.20130427225902768;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.776; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121537226unloadcollection1_2n/index.20130427225902768
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.777; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121537226unloadcollection1_2n/index.20130427225902768
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.777; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.777; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.777; org.apache.solr.cloud.ZkController; publishing core=unloadcollection2 state=active
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.777; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:02.778; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=unloadcollection2
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.208; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.209; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "collection":"unloadcollection",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "core":"unloadcollection2",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:52032__unloadcollection2",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:52032",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:52032_"}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.212; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.212; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.212; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.212; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.212; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.212; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.212; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.752; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.753; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished - collection: unloadcollection
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.754; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.769; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[6 (1433530839868637184)]} 0 2
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.769; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&version=2} {add=[6 (1433530839868637184)]} 0 11
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.775; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[7 (1433530839882268672)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.776; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&version=2} {add=[7 (1433530839882268672)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.781; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[8 (1433530839888560128)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.782; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1433530839888560128)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.789; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.791; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10c247 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c0ed0),segFN=segments_2,generation=2}
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10c247 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c0ed0),segFN=segments_3,generation=3}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.792; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.793; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@ef34c5 main
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.793; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.794; org.apache.solr.core.SolrCore; [unloadcollection1] Registered new searcher Searcher@ef34c5 main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C3)}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.795; org.apache.solr.update.SolrCmdDistributor; Distrib commit to:[StdNode: http://127.0.0.1:52032/unloadcollection2/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.797; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.800; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@11d508d lockFactory=org.apache.lucene.store.NativeFSLockFactory@1885be),segFN=segments_2,generation=2}
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@11d508d lockFactory=org.apache.lucene.store.NativeFSLockFactory@1885be),segFN=segments_3,generation=3}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.801; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.853; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@4613b7 main
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.853; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.854; org.apache.solr.core.SolrCore; [unloadcollection2] Registered new searcher Searcher@4613b7 main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C3)}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.854; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&version=2&commit_end_point=true&expungeDeletes=false&softCommit=false&waitSearcher=true&commit=true} {commit=} 0 57
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.855; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&version=2&softCommit=false&waitSearcher=true&commit=true} {commit=} 0 67
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.855; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.859; org.apache.solr.core.CoreContainer; Creating SolrCore 'unloadcollection3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367121532016/unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.859; org.apache.solr.cloud.ZkController; Check for collection zkNode:unloadcollection
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.860; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.860; org.apache.solr.cloud.ZkController; Load collection config from:/collections/unloadcollection
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.861; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367121532016/unloadcollection3/'
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.890; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.933; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.935; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:03.938; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.332; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.337; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.339; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.349; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.352; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.355; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 03:59:04.356; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 03:59:04.356; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.357; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 03:59:04.358; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 03:59:04.358; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.358; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.359; org.apache.solr.core.SolrCore; [unloadcollection3] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367121532016/unloadcollection3/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121543858unloadcollection_3n/
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.359; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@da6fb3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.359; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.360; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121543858unloadcollection_3n
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.360; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121543858unloadcollection_3n/index/
[junit4:junit4]   1> WARN  - 2013-04-28 03:59:04.361; org.apache.solr.core.SolrCore; [unloadcollection3] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121543858unloadcollection_3n/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.361; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121543858unloadcollection_3n/index
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.362; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ec0238 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1840542),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.363; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.364; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.365; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.365; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.366; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.366; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.366; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.367; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.367; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.367; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.370; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.372; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@154daa4 main
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.372; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121543858unloadcollection_3n/tlog
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.373; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.373; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.399; org.apache.solr.core.SolrCore; [unloadcollection3] Registered new searcher Searcher@154daa4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.399; org.apache.solr.cloud.ZkController; publishing core=unloadcollection3 state=down
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.400; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.716; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.717; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "collection":"unloadcollection",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "core":"unloadcollection3",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:37153",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:37153_"}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.717; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.717; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.721; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.722; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.722; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.722; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.722; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.722; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:04.721; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:05.401; org.apache.solr.core.CoreContainer; registering core: unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:05.401; org.apache.solr.cloud.ZkController; Register replica - core:unloadcollection3 address:http://127.0.0.1:37153 collection:unloadcollection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:05.405; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:37153/unloadcollection3/ and leader is http://127.0.0.1:53260/unloadcollection1/
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:05.405; org.apache.solr.cloud.ZkController; No LogReplay needed for core=unloadcollection3 baseURL=http://127.0.0.1:37153
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:05.405; org.apache.solr.cloud.ZkController; Core needs to recover:unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:05.405; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:05.406; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=unloadcollection3 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:05.406; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:05.406; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:05.406; org.apache.solr.cloud.ZkController; publishing core=unloadcollection3 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:05.407; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:05.407; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={wt=javabin&collection=unloadcollection&name=unloadcollection3&version=2&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121543858unloadcollection_3n&action=CREATE} status=0 QTime=1548 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:05.408; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:05.408; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:05.409; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:05.412; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:37153__unloadcollection3, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:06.226; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:06.227; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "collection":"unloadcollection",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "core":"unloadcollection3",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:37153__unloadcollection3",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:37153",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:37153_"}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:06.230; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:06.230; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:06.230; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:06.230; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:06.230; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:06.230; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:06.230; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:06.411; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:06.412; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:37153__unloadcollection3, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:06.413; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={wt=javabin&state=recovering&version=2&coreNodeName=127.0.0.1:37153__unloadcollection3&core=unloadcollection1&onlyIfLeader=true&checkLive=true&nodeName=127.0.0.1:37153_&action=PREPRECOVERY} status=0 QTime=1001 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:07.413; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.414; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:53260/unloadcollection1/ core=unloadcollection3 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.414; org.apache.solr.update.PeerSync; PeerSync: core=unloadcollection3 url=http://127.0.0.1:37153 START replicas=[http://127.0.0.1:53260/unloadcollection1/] nUpdates=100
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.415; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> WARN  - 2013-04-28 03:59:08.415; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.415; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.416; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.416; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.416; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.416; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:53260/unloadcollection1/. core=unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.417; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.417; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/get params={getVersions=100&wt=javabin&qt=/get&version=2&distrib=false} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.421; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.422; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10c247 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c0ed0),segFN=segments_2,generation=2}
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10c247 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c0ed0),segFN=segments_3,generation=3}
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10c247 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c0ed0),segFN=segments_4,generation=4}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.423; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.423; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.423; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&version=2&openSearcher=false&commit_end_point=true&softCommit=false&waitSearcher=true&commit=true} {commit=} 0 2
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.424; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.424; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.426; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=javabin&qt=/replication&version=2&command=indexversion} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.426; org.apache.solr.handler.SnapPuller; Master's generation: 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.427; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.427; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.429; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=javabin&qt=/replication&version=2&generation=4&command=filelist} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.429; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 22
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.430; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121543858unloadcollection_3n/index.20130427225908429
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.430; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d0d93e lockFactory=org.apache.lucene.store.NativeFSLockFactory@45a2ea) fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.432; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=_0.nvd&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.435; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=_0_MockSep_0.tii&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.438; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=_0_MockSep_0.pos&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.440; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=_0_MockSep_0.frq&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.443; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=_0.fnm&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.451; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=_0_Disk_0.dvdd&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.454; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=_0_NestedPulsing_0.pos&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.457; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=_0.fdx&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.460; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=_0.nvm&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.463; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=_0_NestedPulsing_0.doc&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.466; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=_0_Disk_0.dvdm&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.469; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=_0.fdt&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.471; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=_0_MockSep_0.tib&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.483; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=_0_MockSep_0.doc&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.486; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=_0_MockSep_0.skp&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> WARN  - 2013-04-28 03:59:08.487; org.apache.solr.handler.SnapPuller$DirectoryFileFetcher; No content recieved for file: {name=_0_MockSep_0.skp, size=0}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.489; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=_0_NestedPulsing_0.tim&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.492; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=_0_NestedPulsing_0.tip&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.495; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=segments_4&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.497; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=_0_MockSep_0.pyl&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> WARN  - 2013-04-28 03:59:08.498; org.apache.solr.handler.SnapPuller$DirectoryFileFetcher; No content recieved for file: {name=_0_MockSep_0.pyl, size=0}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.500; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=_0_Memory_1.ram&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.502; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=_0_Memory_0.ram&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.510; org.apache.solr.core.SolrCore; [unloadcollection1] webapp= path=/replication params={wt=filestream&file=_0.si&qt=/replication&checksum=true&generation=4&command=filecontent} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.510; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.512; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.512; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.513; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ec0238 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1840542),segFN=segments_1,generation=1}
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ec0238 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1840542),segFN=segments_4,generation=4}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.514; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.514; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.515; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@163b20d main
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.516; org.apache.solr.core.SolrCore; [unloadcollection3] Registered new searcher Searcher@163b20d main{StandardDirectoryReader(segments_4:3:nrt _0(5.0):C3)}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.516; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121543858unloadcollection_3n/index.20130427225908429 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121543858unloadcollection_3n/index.20130427225908429;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.516; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121543858unloadcollection_3n/index.20130427225908429
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.517; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121543858unloadcollection_3n/index.20130427225908429
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.517; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.517; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.517; org.apache.solr.cloud.ZkController; publishing core=unloadcollection3 state=active
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.517; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:08.518; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=unloadcollection3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.235; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.236; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "collection":"unloadcollection",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "core":"unloadcollection3",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:37153__unloadcollection3",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:37153",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:37153_"}
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.239; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.240; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.240; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.240; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.240; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.240; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.239; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.417; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.417; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished - collection: unloadcollection
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.418; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.432; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[20 (1433530845811965952)]} 0 2
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.432; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[20 (1433530845811965952)]} 0 2
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.433; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[20 (1433530845811965952)]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.433; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[20]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.440; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[21 (1433530845822451712)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.440; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[21 (1433530845822451712)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.441; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[21 (1433530845822451712)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.441; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[21]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.448; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[22 (1433530845830840320)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.448; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[22 (1433530845830840320)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.449; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[22 (1433530845830840320)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.450; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[22]} 0 7
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.456; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[23 (1433530845839228928)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.457; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[23 (1433530845839228928)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.457; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[23 (1433530845839228928)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.458; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[23]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.465; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[24 (1433530845848666112)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.465; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[24 (1433530845848666112)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.465; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[24 (1433530845848666112)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.466; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[24]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.472; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[25 (1433530845857054720)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.472; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[25 (1433530845857054720)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.473; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[25 (1433530845857054720)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.474; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[25]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.480; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[26 (1433530845864394752)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.480; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[26 (1433530845864394752)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.481; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[26 (1433530845864394752)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.481; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[26]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.488; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[27 (1433530845872783360)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.488; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[27 (1433530845872783360)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.488; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[27 (1433530845872783360)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.489; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[27]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.495; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[28 (1433530845881171968)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.496; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[28 (1433530845881171968)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.496; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[28 (1433530845881171968)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.497; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[28]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.504; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[29 (1433530845889560576)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.504; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[29 (1433530845889560576)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.505; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[29 (1433530845889560576)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.505; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[29]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.512; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[30 (1433530845897949184)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.512; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[30 (1433530845897949184)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.513; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[30 (1433530845897949184)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.513; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[30]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.520; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[31 (1433530845906337792)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.520; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[31 (1433530845906337792)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.521; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[31 (1433530845906337792)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.522; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[31]} 0 7
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.529; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[32 (1433530845915774976)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.529; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[32 (1433530845915774976)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.529; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[32 (1433530845915774976)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.530; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[32]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.537; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[33 (1433530845924163584)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.537; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[33 (1433530845924163584)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.538; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[33 (1433530845924163584)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.538; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[33]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.545; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[34 (1433530845932552192)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.545; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[34 (1433530845932552192)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.545; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[34 (1433530845932552192)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.546; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[34]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.552; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[35 (1433530845940940800)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.552; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[35 (1433530845940940800)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.553; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[35 (1433530845940940800)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.553; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[35]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.561; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[36 (1433530845948280832)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.561; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[36 (1433530845948280832)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.562; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[36 (1433530845948280832)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.563; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[36]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.570; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[37 (1433530845958766592)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.570; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[37 (1433530845958766592)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.571; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[37 (1433530845958766592)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.571; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[37]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.588; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[38 (1433530845977640960)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.588; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[38 (1433530845977640960)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.589; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[38 (1433530845977640960)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.590; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[38]} 0 17
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.596; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[39 (1433530845987078144)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.596; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[39 (1433530845987078144)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.597; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[39 (1433530845987078144)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.598; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[39]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.604; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[40 (1433530845994418176)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.604; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[40 (1433530845994418176)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.605; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[40 (1433530845994418176)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.605; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[40]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.611; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[41 (1433530846002806784)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.611; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[41 (1433530846002806784)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.612; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[41 (1433530846002806784)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.612; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[41]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.619; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[42 (1433530846010146816)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.619; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[42 (1433530846010146816)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.620; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[42 (1433530846010146816)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.620; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[42]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.627; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[43 (1433530846018535424)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.627; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[43 (1433530846018535424)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.627; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[43 (1433530846018535424)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.628; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[43]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.634; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[44 (1433530846026924032)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.634; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[44 (1433530846026924032)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.635; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[44 (1433530846026924032)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.636; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[44]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.642; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[45 (1433530846034264064)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.642; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[45 (1433530846034264064)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.643; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[45 (1433530846034264064)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.643; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[45]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.649; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[46 (1433530846042652672)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.649; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[46 (1433530846042652672)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.650; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[46 (1433530846042652672)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.650; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[46]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.657; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[47 (1433530846049992704)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.657; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[47 (1433530846049992704)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.658; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[47 (1433530846049992704)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.659; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[47]} 0 7
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.665; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[48 (1433530846059429888)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.665; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[48 (1433530846059429888)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.666; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[48 (1433530846059429888)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.667; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[48]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.673; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[49 (1433530846066769920)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.673; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[49 (1433530846066769920)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.674; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[49 (1433530846066769920)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.674; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[49]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.681; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[50 (1433530846075158528)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.681; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[50 (1433530846075158528)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.682; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[50 (1433530846075158528)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.682; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[50]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.688; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[51 (1433530846083547136)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.688; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[51 (1433530846083547136)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.689; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[51 (1433530846083547136)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.689; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[51]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.695; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[52 (1433530846090887168)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.695; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[52 (1433530846090887168)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.696; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[52 (1433530846090887168)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.697; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[52]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.704; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[53 (1433530846099275776)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.704; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[53 (1433530846099275776)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.705; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[53 (1433530846099275776)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.706; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[53]} 0 7
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.712; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[54 (1433530846107664384)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.712; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[54 (1433530846107664384)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.713; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[54 (1433530846107664384)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.713; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[54]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.720; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[55 (1433530846116052992)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.720; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[55 (1433530846116052992)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.721; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[55 (1433530846116052992)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.722; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[55]} 0 7
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.729; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[56 (1433530846125490176)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.729; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[56 (1433530846125490176)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.730; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[56 (1433530846125490176)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.731; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[56]} 0 7
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.738; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[57 (1433530846134927360)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.738; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[57 (1433530846134927360)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.739; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[57 (1433530846134927360)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.739; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[57]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.746; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[58 (1433530846143315968)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.747; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[58 (1433530846143315968)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.747; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[58 (1433530846143315968)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.748; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[58]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.754; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[59 (1433530846151704576)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.754; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[59 (1433530846151704576)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.755; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[59 (1433530846151704576)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.756; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[59]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.762; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[60 (1433530846160093184)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.762; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[60 (1433530846160093184)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.762; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:37153/unloadcollection3/} {add=[60 (1433530846160093184)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.763; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp= path=/update params={wt=javabin&version=2} {add=[60]} 0 6
[junit4:junit4]   1> INFO  - 2013-04-28 03:59:09.770; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:53260/unloadcollection1/} {add=[61 (1433530846168481792)]

[...truncated too long message...]

losing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-28 04:01:07.165; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-28 04:01:07.171; org.apache.solr.core.SolrCore; [unloadcollection4] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-28 04:01:07.172; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-28 04:01:07.172; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121551325unloadcollection_4n [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121551325unloadcollection_4n;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-28 04:01:07.172; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121551325unloadcollection_4n
[junit4:junit4]   1> INFO  - 2013-04-28 04:01:07.173; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121551325unloadcollection_4n/index.20130427225923939 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121551325unloadcollection_4n/index.20130427225923939;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-28 04:01:07.173; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285/1367121551325unloadcollection_4n/index.20130427225923939
[junit4:junit4]   1> INFO  - 2013-04-28 04:01:07.174; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89595676543352844-127.0.0.1:47315_-n_0000000004) am no longer a leader.
[junit4:junit4]   1> INFO  - 2013-04-28 04:01:07.175; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-28 04:01:07.176; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> WARN  - 2013-04-28 04:01:07.176; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> WARN  - 2013-04-28 04:01:07.176; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> WARN  - 2013-04-28 04:01:07.176; org.apache.zookeeper.server.NIOServerCnxn; caught end of stream exception
[junit4:junit4]   1> EndOfStreamException: Unable to read additional data from client sessionid 0x13e4ecb09c7000c, likely client has closed socket
[junit4:junit4]   1> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   1> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   1> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   1> INFO  - 2013-04-28 04:01:07.178; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (0)
[junit4:junit4]   1> INFO  - 2013-04-28 04:01:07.198; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4]   1> INFO  - 2013-04-28 04:01:07.251; org.apache.solr.SolrTestCaseJ4; ###Ending testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-28 04:01:07.252; org.apache.solr.cloud.ZkTestServer; connecting to 127.0.0.1:53839 53839
[junit4:junit4]   1> INFO  - 2013-04-28 04:01:07.354; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@f3cae5 name:ZooKeeperConnection Watcher:127.0.0.1:53839/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 04:01:07.355; org.apache.solr.common.cloud.ConnectionManager; Client->ZooKeeper status change trigger but we are already closed
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367121529285
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=UnloadDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=5F754B23DC97029E -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=nl -Dtests.timezone=Mexico/General -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE  138s J1 | UnloadDistributedZkTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([5F754B23DC97029E:DE93C53BABC862A2]:0)
[junit4:junit4]    > 	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:127)
[junit4:junit4]    > 	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   1> INFO  - 2013-04-28 04:01:07.393; org.apache.solr.SolrTestCaseJ4; ###deleteCore
[junit4:junit4]   2> 138125 T1875 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {multiDefault=PostingsFormat(name=MockSep), a_si=PostingsFormat(name=Memory doPackFST= false), timestamp=PostingsFormat(name=MockSep), id=PostingsFormat(name=NestedPulsing), text=PostingsFormat(name=Memory doPackFST= true), a_t=PostingsFormat(name=MockSep), _version_=PostingsFormat(name=Memory doPackFST= false), range_facet_si=PostingsFormat(name=MockSep), range_facet_sl=PostingsFormat(name=NestedPulsing), range_facet_l=PostingsFormat(name=MockSep), other_tl1=PostingsFormat(name=Memory doPackFST= false), intDefault=PostingsFormat(name=Memory doPackFST= false)}, docValues:{timestamp=DocValuesFormat(name=Disk)}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=nl, timezone=Mexico/General
[junit4:junit4]   2> NOTE: Linux 3.2.0-40-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=2,free=34479352,total=134045696
[junit4:junit4]   2> NOTE: All tests run in this JVM: [SignatureUpdateProcessorFactoryTest, PreAnalyzedUpdateProcessorTest, TestBM25SimilarityFactory, FileUtilsTest, TestJmxIntegration, BadIndexSchemaTest, TestIndexSearcher, QueryResultKeyTest, OpenExchangeRatesOrgProviderTest, SolrCoreCheckLockOnStartupTest, TestDefaultSimilarityFactory, TestSolrJ, TestQuerySenderNoQuery, TestAnalyzedSuggestions, RequestHandlersTest, StatsComponentTest, TestLMJelinekMercerSimilarityFactory, DistanceFunctionTest, CopyFieldTest, TestDistributedGrouping, SimplePostToolTest, NotRequiredUniqueKeyTest, TestCSVLoader, TestRecovery, HardAutoCommitTest, ChaosMonkeySafeLeaderTest, FullSolrCloudDistribCmdsTest, TestSolrQueryParserResource, TestCodecSupport, OutputWriterTest, TestFieldCollectionResource, SortByFunctionTest, SolrCmdDistributorTest, TestLuceneMatchVersion, XmlUpdateRequestHandlerTest, SolrRequestParserTest, EchoParamsTest, BasicZkTest, CollectionsAPIDistributedZkTest, XsltUpdateRequestHandlerTest, BadCopyFieldTest, TestFoldingMultitermQuery, TestZkChroot, URLClassifyProcessorTest, TestStressLucene, NumericFieldsTest, TestDistributedSearch, DirectUpdateHandlerTest, TestRTGBase, ConvertedLegacyTest, SuggesterTSTTest, TestComponentsName, PathHierarchyTokenizerFactoryTest, SuggesterWFSTTest, JSONWriterTest, TestSuggestSpellingConverter, TestHashPartitioner, RequiredFieldsTest, TestIndexingPerformance, TestCoreDiscovery, ZkNodePropsTest, TestFieldTypeResource, TestNumberUtils, TestBinaryField, TestSystemIdResolver, SpellPossibilityIteratorTest, TestQueryTypes, LeaderElectionIntegrationTest, TestCollationField, DocumentAnalysisRequestHandlerTest, ClusterStateTest, TestSolrQueryParserDefaultOperatorResource, UnloadDistributedZkTest]
[junit4:junit4] Completed on J1 in 138.90s, 1 test, 1 failure <<< FAILURES!

[...truncated 485 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:378: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:358: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:437: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1240: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:884: There were test failures: 293 suites, 1219 tests, 1 failure, 13 ignored (7 assumptions)

Total time: 42 minutes 25 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-ea-b86 -server -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0-ea-b86) - Build # 5384 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/5384/
Java: 32bit/jdk1.8.0-ea-b86 -server -XX:+UseSerialGC

2 tests failed.
REGRESSION:  org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch

Error Message:
Still found shard2 in collection test_unload_shard_and_collection

Stack Trace:
java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
	at __randomizedtesting.SeedInfo.seed([A679411EF7FD6F08:279FCF0680A20F34]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:127)
	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:490)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Server at http://127.0.0.1:55782/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:55782/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
	at __randomizedtesting.SeedInfo.seed([A679411EF7FD6F08:279FCF0680A20F34]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:387)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:490)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9031 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.148; org.apache.solr.BaseDistributedSearchTestCase; Setting hostContext system property: /
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.154; org.apache.solr.SolrTestCaseJ4; ###Starting testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.155; org.apache.solr.cloud.ZkTestServer; STARTING ZK TEST SERVER
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.155; org.apache.solr.cloud.ZkTestServer$ZKServerMain; Starting server
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.255; org.apache.solr.cloud.ZkTestServer; start zk server on port:36740
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.257; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.259; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1cb9145 name:ZooKeeperConnection Watcher:127.0.0.1:36740 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.259; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.260; org.apache.solr.common.cloud.SolrZkClient; makePath: /solr
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.264; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.266; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@10c68cc name:ZooKeeperConnection Watcher:127.0.0.1:36740/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.267; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.267; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.272; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/shards
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.275; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.278; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/shards
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.281; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.282; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.287; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.288; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.293; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.293; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.296; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.296; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.298; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.299; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.302; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.302; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.304; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.305; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.307; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.308; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.310; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.311; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.379; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.392; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:48799
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.393; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.393; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.393; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367131877314
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.394; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367131877314/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.394; org.apache.solr.core.CoreContainer; New CoreContainer 19021914
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.395; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367131877314/'
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.395; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367131877314/'
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.447; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.447; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.448; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.448; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.448; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.449; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.449; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.449; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.450; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.450; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.454; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.454; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:36740/solr
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.455; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.456; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.457; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@2363ed name:ZooKeeperConnection Watcher:127.0.0.1:36740 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.458; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.459; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.463; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.464; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@261a1d name:ZooKeeperConnection Watcher:127.0.0.1:36740/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.465; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.466; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.469; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/collection-queue-work
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.472; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.479; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48799_
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.480; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:48799_
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.483; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/election
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.490; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.492; org.apache.solr.cloud.Overseer; Overseer (id=89596354701426691-127.0.0.1:48799_-n_0000000000) starting
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.494; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue-work
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.498; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.498; org.apache.solr.common.cloud.SolrZkClient; makePath: /clusterstate.json
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.500; org.apache.solr.common.cloud.SolrZkClient; makePath: /aliases.json
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.502; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.504; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.506; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367131877314/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.507; org.apache.solr.cloud.ZkController; Check for collection zkNode:control_collection
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.507; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.507; org.apache.solr.cloud.ZkController; Load collection config from:/collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.508; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367131877314/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.509; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367131877314/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.509; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367131877314/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.534; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.568; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.570; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.575; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:17.993; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.002; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.006; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.026; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.031; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.037; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:18.038; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:18.039; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.039; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:18.041; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:18.041; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.041; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.042; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367131877314/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/control/data/
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.042; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a703c4
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.043; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.044; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/control/data
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.044; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/control/data/index/
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:18.044; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.045; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/control/data/index
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.047; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d95ab8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@199cb5b),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.047; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.050; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.050; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.051; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.052; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.053; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.053; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.053; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.054; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.055; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.058; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.062; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1da9757 main
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.063; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/control/data/tlog
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.064; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.064; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.069; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.069; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:18.072; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1da9757 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:19.008; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:19.009; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:48799",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:48799_",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:19.009; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection control_collection with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:19.009; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:19.015; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:19.073; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:19.073; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:48799 collection:control_collection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:19.074; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:19.084; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:19.087; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:19.087; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:19.087; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:48799/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:19.087; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:19.088; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:48799/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:19.088; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:48799/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:19.088; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.519; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.528; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.546; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:48799/collection1/ and leader is http://127.0.0.1:48799/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.546; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48799
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.547; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.547; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.547; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.550; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.551; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.552; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.552; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.566; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.567; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.569; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@18e333a name:ZooKeeperConnection Watcher:127.0.0.1:36740/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.569; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.571; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.573; org.apache.solr.cloud.ChaosMonkey; monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.674; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.676; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:60799
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.677; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.678; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.678; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367131880574
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.679; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367131880574/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.679; org.apache.solr.core.CoreContainer; New CoreContainer 14599029
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.680; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367131880574/'
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.680; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367131880574/'
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.752; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.753; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.754; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.754; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.755; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.755; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.756; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.757; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.757; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.758; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.764; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.765; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:36740/solr
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.766; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.768; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.769; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@15b9262 name:ZooKeeperConnection Watcher:127.0.0.1:36740 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.769; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.771; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.776; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.777; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@6d66fe name:ZooKeeperConnection Watcher:127.0.0.1:36740/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.777; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:20.783; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:21.786; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60799_
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:21.789; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:60799_
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:21.791; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:21.792; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:21.792; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:21.794; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:21.798; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367131880574/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:21.798; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:21.799; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:21.799; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:21.800; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367131880574/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:21.801; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367131880574/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:21.801; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367131880574/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:21.829; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:21.881; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:21.882; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:21.887; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.033; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.034; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:48799",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:48799_",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:48799__collection1",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.037; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.037; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.037; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.250; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.257; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.259; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.272; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.276; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.284; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:22.286; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:22.286; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.287; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:22.288; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:22.288; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.288; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.288; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367131880574/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty1/
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.289; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a703c4
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.289; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.290; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.290; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty1/index/
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:22.290; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.290; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty1/index
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.292; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3ce90e lockFactory=org.apache.lucene.store.NativeFSLockFactory@be423e),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.292; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.294; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.294; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.295; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.295; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.296; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.296; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.297; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.297; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.298; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.300; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.303; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@16bad3f main
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.303; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty1/tlog
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.304; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.304; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.308; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@16bad3f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.311; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:22.311; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:23.542; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:23.543; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:60799",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:60799_",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:23.543; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection collection1 with numShards 2
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:23.543; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:23.548; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:23.548; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:23.548; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:24.313; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:24.314; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:60799 collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:24.314; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:24.320; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:24.322; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:24.322; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:24.322; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:60799/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:24.323; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:24.323; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:60799/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:24.323; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:60799/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:24.323; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.053; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.060; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.060; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.061; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.082; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:60799/collection1/ and leader is http://127.0.0.1:60799/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.083; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60799
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.083; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.083; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.084; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.085; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.087; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.087; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.088; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.176; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.178; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:55782
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.179; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.180; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.180; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367131885094
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.181; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367131885094/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.182; org.apache.solr.core.CoreContainer; New CoreContainer 4707081
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.182; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367131885094/'
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.183; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367131885094/'
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.237; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.238; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.238; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.239; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.239; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.240; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.240; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.240; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.241; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.241; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.245; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.245; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:36740/solr
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.246; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.247; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.248; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1650982 name:ZooKeeperConnection Watcher:127.0.0.1:36740 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.249; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.251; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.255; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.257; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@19990e1 name:ZooKeeperConnection Watcher:127.0.0.1:36740/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.257; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:25.261; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.265; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55782_
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.266; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:55782_
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.268; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.268; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.269; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.269; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.269; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.270; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.270; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.274; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367131885094/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.274; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.274; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.275; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.276; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367131885094/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.276; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367131885094/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.277; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367131885094/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.309; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.345; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.347; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.351; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.566; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.567; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:60799",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:60799_",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:60799__collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.578; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.579; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.578; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.578; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.744; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.750; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.752; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.765; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.769; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.773; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:26.774; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:26.775; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.776; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:26.777; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:26.777; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.778; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.778; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367131885094/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty2/
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.778; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a703c4
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.779; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.780; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty2
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.780; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty2/index/
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:26.781; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.781; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty2/index
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.784; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@eec36 lockFactory=org.apache.lucene.store.NativeFSLockFactory@10f664d),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.784; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.787; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.787; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.788; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.789; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.790; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.790; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.790; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.791; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.792; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.795; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.797; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@14176a6 main
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.798; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty2/tlog
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.798; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.799; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.802; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@14176a6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.804; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:26.804; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:28.084; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:28.085; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:55782",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:55782_",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:28.085; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:28.085; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:28.089; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:28.089; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:28.089; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:28.089; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:28.807; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:28.807; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:55782 collection:collection1 shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:28.808; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:28.813; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:28.817; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:28.818; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:28.818; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:55782/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:28.818; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:28.819; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:55782/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:28.819; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:55782/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:28.819; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.594; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.600; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.600; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.600; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.600; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.627; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:55782/collection1/ and leader is http://127.0.0.1:55782/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.627; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55782
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.628; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.628; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.628; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.630; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.631; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.632; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.632; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.699; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.701; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:42636
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.702; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.703; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.703; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367131889636
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.703; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367131889636/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.704; org.apache.solr.core.CoreContainer; New CoreContainer 30384593
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.704; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367131889636/'
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.705; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367131889636/'
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.755; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.755; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.756; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.756; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.756; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.757; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.757; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.757; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.758; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.758; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.762; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.763; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:36740/solr
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.763; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.764; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.765; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@11d4f4 name:ZooKeeperConnection Watcher:127.0.0.1:36740 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.766; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.767; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.771; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.773; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@18a3eb4 name:ZooKeeperConnection Watcher:127.0.0.1:36740/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.773; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:29.776; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.779; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42636_
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.781; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:42636_
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.783; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.784; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.784; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.784; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.784; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.784; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.785; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.784; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.785; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.789; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367131889636/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.789; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.790; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.790; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.797; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367131889636/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.798; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367131889636/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.798; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367131889636/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.822; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.857; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.858; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:30.862; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.106; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.107; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:55782",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:55782_",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:55782__collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.111; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.111; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.111; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.111; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.112; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.223; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.229; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.231; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.245; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.248; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.251; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:31.252; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:31.253; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.253; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:31.254; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:31.254; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.254; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.255; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367131889636/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty3/
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.255; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a703c4
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.255; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.256; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty3
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.256; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty3/index/
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:31.256; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.257; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty3/index
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.258; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2c018c lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d56154),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.258; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.260; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.261; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.261; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.262; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.262; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.262; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.263; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.263; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.264; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.266; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.268; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@135c6a main
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.269; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty3/tlog
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.269; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.270; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.274; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@135c6a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.276; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:31.276; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:32.617; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:32.618; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:42636",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:42636_",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:32.618; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:32.618; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:32.622; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:32.622; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:32.622; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:32.622; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:32.622; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.278; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.279; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:42636 collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.282; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:42636/collection1/ and leader is http://127.0.0.1:60799/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.282; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:42636
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.282; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.283; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.288; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.288; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.289; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.290; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.292; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.291; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.292; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.292; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.294; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.304; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:42636__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.382; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.385; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:56885
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.385; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.386; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.386; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367131893297
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.386; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367131893297/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.387; org.apache.solr.core.CoreContainer; New CoreContainer 20164902
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.387; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367131893297/'
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.388; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367131893297/'
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.435; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.435; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.436; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.436; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.436; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.437; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.437; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.437; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.438; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.438; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.442; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.443; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:36740/solr
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.443; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.444; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.450; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@19c5ba4 name:ZooKeeperConnection Watcher:127.0.0.1:36740 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.451; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.455; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.460; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.462; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1b1f832 name:ZooKeeperConnection Watcher:127.0.0.1:36740/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.462; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:33.466; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.127; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.128; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:42636",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:42636_",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:42636__collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.132; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.132; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.132; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.132; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.132; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.132; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.305; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:42636__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.306; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={version=2&nodeName=127.0.0.1:42636_&wt=javabin&onlyIfLeader=true&checkLive=true&coreNodeName=127.0.0.1:42636__collection1&state=recovering&action=PREPRECOVERY&core=collection1} status=0 QTime=1003 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.469; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56885_
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.470; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:56885_
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.472; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.473; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.473; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.473; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.473; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.474; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.473; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.475; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.474; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.474; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.476; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.478; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.481; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367131893297/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.481; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.482; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.482; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.483; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367131893297/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.483; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367131893297/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.484; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367131893297/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.507; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.542; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.543; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.547; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.885; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.893; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.896; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.911; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.916; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.919; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:34.921; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:34.921; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.921; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:34.922; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:34.923; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.923; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.923; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367131893297/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty4/
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.923; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a703c4
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.924; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.924; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty4
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.925; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty4/index/
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:34.925; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.925; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty4/index
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.927; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1299149 lockFactory=org.apache.lucene.store.NativeFSLockFactory@992451),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.927; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.929; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.929; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.930; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.930; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.931; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.931; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.931; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.932; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.932; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.942; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.944; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@6bb668 main
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.944; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty4/tlog
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.945; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.945; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.950; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@6bb668 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.953; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:34.953; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.637; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.638; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:56885",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:56885_",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.639; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.639; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.644; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.644; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.645; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.644; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.644; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.644; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.955; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.955; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:56885 collection:collection1 shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.958; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:56885/collection1/ and leader is http://127.0.0.1:55782/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.959; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56885
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.959; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.959; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.959; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.960; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.961; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.961; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.961; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.962; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.962; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.963; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.963; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.970; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.971; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:56885__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.972; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.985; org.apache.solr.core.CoreContainer; Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367131880574/onenodecollectioncore
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.986; org.apache.solr.cloud.ZkController; Check for collection zkNode:onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.986; org.apache.solr.cloud.ZkController; Creating collection in ZooKeeper:onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.987; org.apache.solr.cloud.ZkController; Looking for collection configName
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.988; org.apache.solr.cloud.ZkController; Only one config set found in zk - using it:conf1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.988; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.990; org.apache.solr.cloud.ZkController; Load collection config from:/collections/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:35.991; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367131880574/onenodecollectioncore/'
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.017; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.053; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.054; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.058; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.307; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:60799/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.312; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.320; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:42636 START replicas=[http://127.0.0.1:60799/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:36.324; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.324; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.325; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.325; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.325; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.326; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:60799/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.327; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.335; org.apache.solr.core.SolrCore; [collection1] webapp= path=/get params={getVersions=100&version=2&distrib=false&wt=javabin&qt=/get} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.341; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.359; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3ce90e lockFactory=org.apache.lucene.store.NativeFSLockFactory@be423e),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.360; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.361; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3ce90e lockFactory=org.apache.lucene.store.NativeFSLockFactory@be423e),segFN=segments_1,generation=1}
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3ce90e lockFactory=org.apache.lucene.store.NativeFSLockFactory@be423e),segFN=segments_2,generation=2}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.361; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.362; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@e05d58 realtime
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.363; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.363; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={version=2&waitSearcher=true&wt=javabin&commit=true&openSearcher=false&softCommit=false&commit_end_point=true} {commit=} 0 28
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.367; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.369; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.375; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.385; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.386; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={version=2&wt=javabin&command=indexversion&qt=/replication} status=0 QTime=9 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.387; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.388; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.388; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.390; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={version=2&generation=2&wt=javabin&command=filelist&qt=/replication} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.395; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.397; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty3/index.20130428095136396
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.398; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@b686a lockFactory=org.apache.lucene.store.NativeFSLockFactory@104ab65) fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.405; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={generation=2&wt=filestream&checksum=true&file=segments_2&command=filecontent&qt=/replication} status=0 QTime=2 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.416; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.418; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.418; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.419; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2c018c lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d56154),segFN=segments_1,generation=1}
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2c018c lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d56154),segFN=segments_2,generation=2}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.420; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.420; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.421; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@167ac8f main
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.422; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@167ac8f main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.422; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty3/index.20130428095136396 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty3/index.20130428095136396;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.423; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty3/index.20130428095136396
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.423; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty3/index.20130428095136396
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.424; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.424; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.424; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.424; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.426; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.607; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.617; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.620; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.638; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.645; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.650; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:36.652; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:36.652; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.653; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:36.655; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:36.655; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.656; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.656; org.apache.solr.core.SolrCore; [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367131880574/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367131877155/onenodecollection/
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.657; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a703c4
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.658; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.659; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367131877155/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.660; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367131877155/onenodecollection/index/
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:36.660; org.apache.solr.core.SolrCore; [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367131877155/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.661; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367131877155/onenodecollection/index
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.663; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@14ad0b7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f79712),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.664; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.667; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.668; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.669; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.670; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.671; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.671; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.672; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.673; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.673; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.677; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.681; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1d7f777 main
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.682; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367131877155/onenodecollection/tlog
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.683; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.683; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.689; org.apache.solr.cloud.ZkController; publishing core=onenodecollectioncore state=down
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:36.691; org.apache.solr.core.SolrCore; [onenodecollectioncore] Registered new searcher Searcher@1d7f777 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.149; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.150; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:56885",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:56885_",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:56885__collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.154; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:42636",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:42636_",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:42636__collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.157; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "roles":"none",
[junit4:junit4]   1>   "collection":"onenodecollection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:60799",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:60799_",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core":"onenodecollectioncore",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.157; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection onenodecollection with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.158; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.162; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.163; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.163; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.162; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.162; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.162; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.692; org.apache.solr.core.CoreContainer; registering core: onenodecollectioncore
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.693; org.apache.solr.cloud.ZkController; Register replica - core:onenodecollectioncore address:http://127.0.0.1:60799 collection:onenodecollection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.694; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.700; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.703; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.703; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.704; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:60799/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.704; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.705; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:60799/onenodecollectioncore/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.705; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:60799/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.706; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.972; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:56885__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:37.972; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={version=2&nodeName=127.0.0.1:56885_&wt=javabin&onlyIfLeader=true&checkLive=true&coreNodeName=127.0.0.1:56885__collection1&state=recovering&action=PREPRECOVERY&core=collection1} status=0 QTime=2001 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:38.670; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:38.678; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:38.679; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:38.679; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:38.679; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:38.679; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:38.678; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:38.715; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:60799/onenodecollectioncore/ and leader is http://127.0.0.1:60799/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:38.716; org.apache.solr.cloud.ZkController; No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:60799
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:38.716; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:38.716; org.apache.solr.cloud.ZkController; publishing core=onenodecollectioncore state=active
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:38.718; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:38.719; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={roles=none&version=2&collection=onenodecollection&wt=javabin&name=onenodecollectioncore&action=CREATE&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367131877155/onenodecollection&numShards=1} status=0 QTime=2739 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:38.720; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:38.721; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.723; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.973; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:55782/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.974; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:56885 START replicas=[http://127.0.0.1:55782/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-28 06:51:39.974; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.974; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.975; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.975; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.975; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.976; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:55782/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.976; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.980; org.apache.solr.core.SolrCore; [collection1] webapp= path=/get params={getVersions=100&version=2&distrib=false&wt=javabin&qt=/get} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.981; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.982; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@eec36 lockFactory=org.apache.lucene.store.NativeFSLockFactory@10f664d),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.982; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.983; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@eec36 lockFactory=org.apache.lucene.store.NativeFSLockFactory@10f664d),segFN=segments_1,generation=1}
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@eec36 lockFactory=org.apache.lucene.store.NativeFSLockFactory@10f664d),segFN=segments_2,generation=2}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.984; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.984; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@11fff53 realtime
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.984; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.985; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={version=2&waitSearcher=true&wt=javabin&commit=true&openSearcher=false&softCommit=false&commit_end_point=true} {commit=} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.986; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.986; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.988; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.988; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={version=2&wt=javabin&command=indexversion&qt=/replication} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.989; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.990; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.990; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.992; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={version=2&generation=2&wt=javabin&command=filelist&qt=/replication} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.993; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.994; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty4/index.20130428095139993
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.994; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@4bab5e lockFactory=org.apache.lucene.store.NativeFSLockFactory@1665246) fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.996; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={generation=2&wt=filestream&checksum=true&file=segments_2&command=filecontent&qt=/replication} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.998; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.998; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:39.999; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.000; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1299149 lockFactory=org.apache.lucene.store.NativeFSLockFactory@992451),segFN=segments_1,generation=1}
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1299149 lockFactory=org.apache.lucene.store.NativeFSLockFactory@992451),segFN=segments_2,generation=2}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.000; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.000; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.001; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@17becea main
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.002; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@17becea main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.002; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty4/index.20130428095139993 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty4/index.20130428095139993;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.002; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty4/index.20130428095139993
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.003; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/jetty4/index.20130428095139993
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.003; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.003; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.003; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.003; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.006; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.187; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.188; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "roles":"none",
[junit4:junit4]   1>   "collection":"onenodecollection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:60799",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:60799_",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "core":"onenodecollectioncore",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:60799__onenodecollectioncore",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.191; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:56885",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:56885_",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:56885__collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.194; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.194; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.194; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.194; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.194; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.194; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.725; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.726; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished - collection: onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.726; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.738; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.739; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1ffaff9 name:ZooKeeperConnection Watcher:127.0.0.1:36740 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.739; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> / (2)
[junit4:junit4]   1> DATA:
[junit4:junit4]   1>     
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1>  /solr (7)
[junit4:junit4]   1>   /solr/live_nodes (5)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:55782_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:48799_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:42636_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:56885_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:60799_ (0)
[junit4:junit4]   1>   /solr/overseer (3)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       
[junit4:junit4]   1>    /solr/overseer/collection-queue-work (0)
[junit4:junit4]   1>    /solr/overseer/queue (0)
[junit4:junit4]   1>    /solr/overseer/queue-work (0)
[junit4:junit4]   1>   /solr/collections (3)
[junit4:junit4]   1>    /solr/collections/onenodecollection (2)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {
[junit4:junit4]   1>          "configName":"conf1",
[junit4:junit4]   1>          "router":"compositeId"}
[junit4:junit4]   1>     /solr/collections/onenodecollection/leaders (1)
[junit4:junit4]   1>      /solr/collections/onenodecollection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:60799",
[junit4:junit4]   1>            "node_name":"127.0.0.1:60799_",
[junit4:junit4]   1>            "core":"onenodecollectioncore"}
[junit4:junit4]   1>     /solr/collections/onenodecollection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/onenodecollection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/onenodecollection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/onenodecollection/leader_elect/shard1/election/89596354701426694-127.0.0.1:60799__onenodecollectioncore-n_0000000000 (0)
[junit4:junit4]   1>    /solr/collections/control_collection (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:48799",
[junit4:junit4]   1>            "node_name":"127.0.0.1:48799_",
[junit4:junit4]   1>            "core":"collection1"}
[junit4:junit4]   1>     /solr/collections/control_collection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/shard1/election/89596354701426691-127.0.0.1:48799__collection1-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/control_collection/shards (0)
[junit4:junit4]   1>    /solr/collections/collection1 (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/collection1/leaders (2)
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:60799",
[junit4:junit4]   1>            "node_name":"127.0.0.1:60799_",
[junit4:junit4]   1>            "core":"collection1"}
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard2 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:55782",
[junit4:junit4]   1>            "node_name":"127.0.0.1:55782_",
[junit4:junit4]   1>            "core":"collection1"}
[junit4:junit4]   1>     /solr/collections/collection1/leader_elect (2)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard1/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89596354701426698-127.0.0.1:42636__collection1-n_0000000001 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89596354701426694-127.0.0.1:60799__collection1-n_0000000000 (0)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard2 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard2/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89596354701426696-127.0.0.1:55782__collection1-n_0000000000 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89596354701426700-127.0.0.1:56885__collection1-n_0000000001 (0)
[junit4:junit4]   1>     /solr/collections/collection1/shards (0)
[junit4:junit4]   1>   /solr/aliases.json (0)
[junit4:junit4]   1>   /solr/clusterstate.json (0)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       {
[junit4:junit4]   1>         "onenodecollection":{
[junit4:junit4]   1>           "router":"compositeId",
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"127.0.0.1:60799__onenodecollectioncore":{
[junit4:junit4]   1>                   "roles":"none",
[junit4:junit4]   1>                   "collection":"onenodecollection",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:60799",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:60799_",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "core":"onenodecollectioncore",
[junit4:junit4]   1>                   "leader":"true"}}}}},
[junit4:junit4]   1>         "collection1":{
[junit4:junit4]   1>           "router":"compositeId",
[junit4:junit4]   1>           "shards":{
[junit4:junit4]   1>             "shard1":{
[junit4:junit4]   1>               "range":"80000000-ffffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "127.0.0.1:60799__collection1":{
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:60799",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:60799_",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "127.0.0.1:42636__collection1":{
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:42636",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:42636_",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "core":"collection1"}}},
[junit4:junit4]   1>             "shard2":{
[junit4:junit4]   1>               "range":"0-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "127.0.0.1:55782__collection1":{
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:55782",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:55782_",
[junit4:junit4]   1>                   "shard":"shard2",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "127.0.0.1:56885__collection1":{
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:56885",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:56885_",
[junit4:junit4]   1>                   "shard":"shard2",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "core":"collection1"}}}}},
[junit4:junit4]   1>         "control_collection":{
[junit4:junit4]   1>           "router":"compositeId",
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"127.0.0.1:48799__collection1":{
[junit4:junit4]   1>                   "collection":"control_collection",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:48799",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:48799_",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "leader":"true"}}}}}}
[junit4:junit4]   1>   /solr/configs (1)
[junit4:junit4]   1>    /solr/configs/conf1 (9)
[junit4:junit4]   1>     /solr/configs/conf1/protwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/solrconfig.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/old_synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/currency.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/open-exchange-rates.json (0)
[junit4:junit4]   1>     DATA:
[junit4:junit4]   1>         {
[junit4:junit4]   1>           "disclaimer": "This data is not real, it was synthetically created to match currency.xml.  It is modeled after the data format available from openexchangerates.org.  See https://openexchangerates.org/documentation for details",
[junit4:junit4]   1>           "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4:junit4]   1>           "timestamp": 1332070464,
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "IMPORTANT NOTE": "In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "base": "USD",
[junit4:junit4]   1>           "rates": {
[junit4:junit4]   1>             "USD": 1,
[junit4:junit4]   1>             "JPY": 81.29,
[junit4:junit4]   1>             "EUR": 2.5,
[junit4:junit4]   1>             "GBP": 0.5,
[junit4:junit4]   1>             "MXN": 2.0
[junit4:junit4]   1>           }
[junit4:junit4]   1>         }
[junit4:junit4]   1>         
[junit4:junit4]   1>     /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/schema.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/stopwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>   /solr/overseer_elect (2)
[junit4:junit4]   1>    /solr/overseer_elect/election (5)
[junit4:junit4]   1>     /solr/overseer_elect/election/89596354701426700-127.0.0.1:56885_-n_0000000004 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89596354701426696-127.0.0.1:55782_-n_0000000002 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89596354701426694-127.0.0.1:60799_-n_0000000001 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89596354701426691-127.0.0.1:48799_-n_0000000000 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89596354701426698-127.0.0.1:42636_-n_0000000003 (0)
[junit4:junit4]   1>    /solr/overseer_elect/leader (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"id":"89596354701426691-127.0.0.1:48799_-n_0000000000"}
[junit4:junit4]   1> 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.789; org.apache.solr.cloud.ChaosMonkey; monkey: stop shard! 48799
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:40.798; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=19021914
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:41.701; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:41.702; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=null message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:48799",
[junit4:junit4]   1>   "node_name":"127.0.0.1:48799_",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:48799__collection1",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:41.706; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:41.706; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:41.706; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:41.706; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:41.706; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.800; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.801; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.802; org.apache.solr.core.SolrCore; [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@17e088a
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.808; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.808; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.808; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.809; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.809; org.apache.solr.core.SolrCore; [collection1] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.810; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.810; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/control/data [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/control/data;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.810; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/control/data
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.811; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/control/data/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/control/data/index;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.811; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367131877154/control/data/index
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.812; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89596354701426691-127.0.0.1:48799_-n_0000000000) am no longer a leader.
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.812; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.813; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.813; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.814; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.814; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.815; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.815; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.817; org.apache.solr.cloud.Overseer; Overseer (id=89596354701426694-127.0.0.1:60799_-n_0000000001) starting
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.821; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.821; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.822; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.821; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.825; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 06:51:42.826; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:48799",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_na

[...truncated too long message...]

96
[junit4:junit4]   1> INFO  - 2013-04-28 07:02:19.989; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=3,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-28 07:02:19.990; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-28 07:02:19.990; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-28 07:02:19.991; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-28 07:02:19.995; org.apache.solr.core.SolrCore; [unloadcollection4] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-28 07:02:19.996; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-28 07:02:19.997; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1367132398997/1367132422876unloadcollection_4n [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1367132398997/1367132422876unloadcollection_4n;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-28 07:02:19.998; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1367132398997/1367132422876unloadcollection_4n
[junit4:junit4]   1> INFO  - 2013-04-28 07:02:19.999; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1367132398997/1367132422876unloadcollection_4n/index.20130428070037634 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1367132398997/1367132422876unloadcollection_4n/index.20130428070037634;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-28 07:02:20.000; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1367132398997/1367132422876unloadcollection_4n/index.20130428070037634
[junit4:junit4]   1> INFO  - 2013-04-28 07:02:20.001; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89596388900798476-127.0.0.1:37191_r_pe-n_0000000004) am no longer a leader.
[junit4:junit4]   1> INFO  - 2013-04-28 07:02:20.003; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> WARN  - 2013-04-28 07:02:20.003; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-28 07:02:20.003; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (0)
[junit4:junit4]   1> WARN  - 2013-04-28 07:02:20.004; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-28 07:02:20.004; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 0)
[junit4:junit4]   1> INFO  - 2013-04-28 07:02:20.024; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/r_pe,null}
[junit4:junit4]   1> INFO  - 2013-04-28 07:02:20.079; org.apache.solr.SolrTestCaseJ4; ###Ending testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-28 07:02:20.083; org.apache.solr.cloud.ZkTestServer; connecting to 127.0.0.1:60673 60673
[junit4:junit4]   1> INFO  - 2013-04-28 07:02:20.186; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@151cfcb name:ZooKeeperConnection Watcher:127.0.0.1:60673/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 07:02:20.187; org.apache.solr.common.cloud.ConnectionManager; Client->ZooKeeper status change trigger but we are already closed
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1367132398997
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=UnloadDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=A679411EF7FD6F08 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_MX -Dtests.timezone=Atlantic/St_Helena -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE  141s J0 | UnloadDistributedZkTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([A679411EF7FD6F08:279FCF0680A20F34]:0)
[junit4:junit4]    > 	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:127)
[junit4:junit4]    > 	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   1> INFO  - 2013-04-28 07:02:20.206; org.apache.solr.SolrTestCaseJ4; ###deleteCore
[junit4:junit4]   2> 141223 T3130 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {timestamp=PostingsFormat(name=Memory doPackFST= true), range_facet_si=PostingsFormat(name=Memory doPackFST= true), text=PostingsFormat(name=SimpleText), a_si=PostingsFormat(name=Asserting), multiDefault=PostingsFormat(name=Memory doPackFST= true), range_facet_sl=PostingsFormat(name=NestedPulsing), range_facet_l=PostingsFormat(name=Memory doPackFST= true), id=PostingsFormat(name=NestedPulsing), a_t=PostingsFormat(name=Memory doPackFST= true), other_tl1=PostingsFormat(name=Asserting), _version_=PostingsFormat(name=Asserting), intDefault=PostingsFormat(name=Asserting)}, docValues:{timestamp=DocValuesFormat(name=Lucene42)}, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=es_MX, timezone=Atlantic/St_Helena
[junit4:junit4]   2> NOTE: Linux 3.2.0-40-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=2,free=16819584,total=156774400
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestFastWriter, CircularListTest, PrimitiveFieldTypeTest, SoftAutoCommitTest, TestFunctionQuery, TestBadConfig, TestSolrIndexConfig, ResponseLogComponentTest, TestCharFilters, PeerSyncTest, CoreAdminHandlerTest, TestTrie, TestUniqueKeyFieldResource, AnalysisAfterCoreReloadTest, ZkCLITest, TestSolrCoreProperties, TestLRUCache, TestSchemaVersionResource, TestSchemaSimilarityResource, DocumentBuilderTest, WordBreakSolrSpellCheckerTest, TestDocumentBuilder, StatelessScriptUpdateProcessorFactoryTest, TestCloudManagedSchema, TestWriterPerf, TestStressRecovery, DirectSolrConnectionTest, SolrCoreTest, CacheHeaderTest, ShardRoutingTest, SyncSliceTest, BadComponentTest, OverseerTest, QueryElevationComponentTest, TestSurroundQueryParser, JsonLoaderTest, TestDynamicFieldCollectionResource, TestSolrDeletionPolicy2, TestConfig, TestReplicationHandler, TestGroupingSearch, TestRemoteStreaming, DistributedTermsComponentTest, SuggesterFSTTest, SuggesterTest, TestStressVersions, SliceStateTest, UUIDFieldTest, LegacyHTMLStripCharFilterTest, SimpleFacetsTest, TestSolrDeletionPolicy1, TestReversedWildcardFilterFactory, SolrInfoMBeanTest, RAMDirectoryFactoryTest, TestXIncludeConfig, TestCoreContainer, SpatialFilterTest, ReturnFieldsTest, QueryParsingTest, TestSearchPerf, DateFieldTest, DirectUpdateHandlerOptimizeTest, ChaosMonkeyNothingIsSafeTest, SliceStateUpdateTest, SynonymTokenizerTest, IndexSchemaTest, SearchHandlerTest, TestSolrXml, BasicFunctionalityTest, TermsComponentTest, TestQuerySenderListener, AliasIntegrationTest, BasicDistributedZkTest, UnloadDistributedZkTest]
[junit4:junit4] Completed on J0 in 142.26s, 1 test, 1 failure <<< FAILURES!

[...truncated 454 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:378: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:358: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:437: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1240: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:884: There were test failures: 293 suites, 1219 tests, 1 error, 1 failure, 13 ignored (7 assumptions)

Total time: 39 minutes 38 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-ea-b86 -server -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0-ea-b86) - Build # 5383 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/5383/
Java: 64bit/jdk1.8.0-ea-b86 -XX:+UseCompressedOops -XX:+UseParallelGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Server at http://127.0.0.1:49707/_s/onenodecollectioncore returned non ok status:404, message:Can not find: /_s/onenodecollectioncore/update

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:49707/_s/onenodecollectioncore returned non ok status:404, message:Can not find: /_s/onenodecollectioncore/update
	at __randomizedtesting.SeedInfo.seed([E0ED5AD42E60CEC5:610BD4CC593FAEF9]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:387)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:490)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9290 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.112; org.apache.solr.BaseDistributedSearchTestCase; Setting hostContext system property: /_s/
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.116; org.apache.solr.SolrTestCaseJ4; ###Starting testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.117; org.apache.solr.cloud.ZkTestServer; STARTING ZK TEST SERVER
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.117; org.apache.solr.cloud.ZkTestServer$ZKServerMain; Starting server
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.217; org.apache.solr.cloud.ZkTestServer; start zk server on port:39908
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.219; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.315; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@7951ca64 name:ZooKeeperConnection Watcher:127.0.0.1:39908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.315; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.316; org.apache.solr.common.cloud.SolrZkClient; makePath: /solr
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.319; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.320; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@77963b3e name:ZooKeeperConnection Watcher:127.0.0.1:39908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.321; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.321; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.324; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/shards
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.327; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.329; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/shards
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.332; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.332; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.336; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.337; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.340; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.341; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.344; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.344; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.347; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.348; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.351; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.351; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.354; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.355; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.357; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.358; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.361; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.362; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.467; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.470; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:51036
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.470; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.471; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.471; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367127053368
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.471; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367127053368/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.472; org.apache.solr.core.CoreContainer; New CoreContainer 961078143
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.472; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367127053368/'
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.473; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367127053368/'
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.533; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.533; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.533; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.534; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.534; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.534; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.535; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.535; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.535; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.536; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.539; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.540; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:39908/solr
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.540; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.541; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.542; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1530c36d name:ZooKeeperConnection Watcher:127.0.0.1:39908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.543; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.544; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.548; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.549; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@2ff2a31 name:ZooKeeperConnection Watcher:127.0.0.1:39908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.550; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.551; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.554; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/collection-queue-work
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.556; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.558; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51036__s
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.559; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:51036__s
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.562; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/election
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.567; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.569; org.apache.solr.cloud.Overseer; Overseer (id=89596038553206787-127.0.0.1:51036__s-n_0000000000) starting
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.571; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue-work
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.575; org.apache.solr.common.cloud.SolrZkClient; makePath: /clusterstate.json
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.575; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.579; org.apache.solr.common.cloud.SolrZkClient; makePath: /aliases.json
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.582; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.585; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.588; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367127053368/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.588; org.apache.solr.cloud.ZkController; Check for collection zkNode:control_collection
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.589; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.589; org.apache.solr.cloud.ZkController; Load collection config from:/collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.590; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367127053368/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.591; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367127053368/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.591; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367127053368/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.618; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.669; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.671; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:53.676; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.035; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.041; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.043; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.057; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.061; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.063; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 05:30:54.065; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 05:30:54.065; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.065; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 05:30:54.066; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 05:30:54.067; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.067; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.067; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1367127053368/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/control/data/
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.067; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@71b2c5cd
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.068; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.068; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/control/data
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.069; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/control/data/index/
[junit4:junit4]   1> WARN  - 2013-04-28 05:30:54.069; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.069; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/control/data/index
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.071; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5b4838e5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@22243723),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.071; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.073; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.073; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.074; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.074; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.075; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.075; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.075; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.076; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.076; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.080; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.083; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@7e324fd6 main
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.083; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/control/data/tlog
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.084; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.084; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.087; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@7e324fd6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.088; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:54.088; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:55.089; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:55.090; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "node_name":"127.0.0.1:51036__s",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core_node_name":"1",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:51036/_s",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:55.090; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection control_collection with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:55.090; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:55.093; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.089; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.090; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:51036/_s collection:control_collection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.090; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.095; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.097; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.097; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.098; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:51036/_s/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.098; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.098; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:51036/_s/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.098; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:51036/_s/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.098; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.597; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.606; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.619; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:51036/_s/collection1/ and leader is http://127.0.0.1:51036/_s/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.619; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51036/_s
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.619; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.620; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.620; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.621; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.622; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.623; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.623; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.626; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.627; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.629; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@5f446912 name:ZooKeeperConnection Watcher:127.0.0.1:39908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.629; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.630; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.632; org.apache.solr.cloud.ChaosMonkey; monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.691; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.693; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:40422
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.694; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.694; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.695; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367127056633
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.695; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367127056633/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.695; org.apache.solr.core.CoreContainer; New CoreContainer 233769106
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.696; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367127056633/'
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.696; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367127056633/'
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.734; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.734; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.735; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.735; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.735; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.736; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.736; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.736; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.736; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.737; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.740; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.740; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:39908/solr
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.740; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.741; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.743; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@3db29743 name:ZooKeeperConnection Watcher:127.0.0.1:39908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.743; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.745; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.748; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.750; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@762cf0c0 name:ZooKeeperConnection Watcher:127.0.0.1:39908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.750; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:56.753; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:57.756; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40422__s
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:57.757; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:40422__s
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:57.760; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:57.760; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:57.760; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:57.761; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:57.765; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367127056633/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:57.765; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:57.766; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:57.766; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:57.767; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367127056633/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:57.768; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367127056633/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:57.768; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367127056633/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:57.790; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:57.817; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:57.819; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:57.822; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.109; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.110; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.111; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "node_name":"127.0.0.1:51036__s",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "core_node_name":"1",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:51036/_s",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.114; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.115; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.114; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.116; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.125; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.137; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.141; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.143; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 05:30:58.145; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 05:30:58.145; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.145; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 05:30:58.146; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 05:30:58.146; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.147; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.147; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367127056633/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty1/
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.147; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@71b2c5cd
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.148; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.148; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty1
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.148; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty1/index/
[junit4:junit4]   1> WARN  - 2013-04-28 05:30:58.148; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.149; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty1/index
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.150; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d56b424 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65605fba),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.150; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.152; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.152; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.152; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.153; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.153; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.153; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.154; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.154; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.154; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.156; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.158; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@402be223 main
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.159; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty1/tlog
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.159; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.159; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.163; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@402be223 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.164; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:58.164; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:59.618; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:59.619; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "node_name":"127.0.0.1:40422__s",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core_node_name":"2",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:40422/_s",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:59.620; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection collection1 with numShards 2
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:59.620; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:59.624; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:59.624; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 05:30:59.624; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:00.165; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:00.165; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:40422/_s collection:collection1 shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:00.166; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:00.173; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:00.175; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:00.175; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:00.175; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:40422/_s/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:00.176; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:00.176; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:40422/_s/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:00.176; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:40422/_s/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:00.176; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.128; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.134; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.134; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.134; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.183; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:40422/_s/collection1/ and leader is http://127.0.0.1:40422/_s/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.183; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40422/_s
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.183; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.183; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.184; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.185; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.186; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.187; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.187; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.253; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.256; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:49707
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.256; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.257; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.257; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367127061190
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.257; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367127061190/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.258; org.apache.solr.core.CoreContainer; New CoreContainer 331614534
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.258; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367127061190/'
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.258; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367127061190/'
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.302; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.303; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.303; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.304; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.304; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.305; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.305; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.306; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.306; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.307; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.312; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.312; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:39908/solr
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.313; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.314; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.316; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@7eadb4 name:ZooKeeperConnection Watcher:127.0.0.1:39908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.316; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.318; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.323; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.324; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@31a482f0 name:ZooKeeperConnection Watcher:127.0.0.1:39908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.325; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:01.328; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.331; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49707__s
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.333; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:49707__s
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.335; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.336; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.336; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.336; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.336; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.337; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.337; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.341; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367127061190/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.342; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.342; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.342; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.344; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367127061190/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.344; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367127061190/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.344; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367127061190/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.366; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.392; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.393; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.397; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.639; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.640; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "node_name":"127.0.0.1:40422__s",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "core_node_name":"2",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:40422/_s",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.644; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.644; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.644; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.644; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.677; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.681; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.684; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.696; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.699; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.701; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:02.702; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:02.703; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.703; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:02.704; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:02.704; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.704; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.704; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1367127061190/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty2/
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.705; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@71b2c5cd
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.705; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.705; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty2
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.706; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty2/index/
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:02.706; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.706; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty2/index
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.707; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@694e39da lockFactory=org.apache.lucene.store.NativeFSLockFactory@5739901e),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.707; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.709; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.709; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.710; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.710; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.711; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.711; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.711; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.711; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.712; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.714; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.716; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@2f9481b5 main
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.716; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty2/tlog
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.717; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.717; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.720; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@2f9481b5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.721; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:02.721; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:04.148; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:04.149; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "node_name":"127.0.0.1:49707__s",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core_node_name":"3",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:49707/_s",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:04.149; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:04.150; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:04.155; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:04.155; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:04.155; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:04.155; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:04.722; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:04.723; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:49707/_s collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:04.724; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:04.730; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:04.732; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:04.733; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:04.733; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:49707/_s/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:04.733; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:04.733; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:49707/_s/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:04.733; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:49707/_s/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:04.734; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.659; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.664; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.664; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.664; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.664; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.691; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:49707/_s/collection1/ and leader is http://127.0.0.1:49707/_s/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.692; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49707/_s
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.692; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.692; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.692; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.694; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.695; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.696; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.696; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.758; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.760; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:54353
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.761; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.761; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.762; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367127065699
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.762; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367127065699/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.762; org.apache.solr.core.CoreContainer; New CoreContainer 878722743
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.763; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367127065699/'
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.763; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367127065699/'
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.800; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.800; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.801; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.801; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.801; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.802; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.802; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.802; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.803; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.803; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.806; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.806; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:39908/solr
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.807; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.807; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.809; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@2ea7b86d name:ZooKeeperConnection Watcher:127.0.0.1:39908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.810; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.811; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.814; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.815; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@5fcb24dc name:ZooKeeperConnection Watcher:127.0.0.1:39908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.816; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:05.819; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.822; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54353__s
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.824; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:54353__s
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.825; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.826; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.827; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.826; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.827; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.827; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.827; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.828; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.828; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.833; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367127065699/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.833; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.834; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.834; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.835; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367127065699/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.835; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367127065699/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.835; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367127065699/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.867; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.898; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.900; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:06.904; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.169; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.170; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "node_name":"127.0.0.1:49707__s",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "core_node_name":"3",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:49707/_s",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.173; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.173; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.173; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.173; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.173; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.194; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.199; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.201; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.212; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.215; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.218; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:07.219; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:07.219; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.219; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:07.220; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:07.220; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.220; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.221; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1367127065699/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty3/
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.221; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@71b2c5cd
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.221; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.222; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty3
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.222; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty3/index/
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:07.222; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.222; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty3/index
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.224; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ed700be lockFactory=org.apache.lucene.store.NativeFSLockFactory@20b5109f),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.224; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.226; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.226; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.226; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.227; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.227; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.227; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.228; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.228; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.228; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.230; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.232; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@17bbce76 main
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.233; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty3/tlog
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.233; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.233; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.237; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@17bbce76 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.239; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:07.239; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:08.682; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:08.683; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "node_name":"127.0.0.1:54353__s",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core_node_name":"4",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54353/_s",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:08.683; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:08.684; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:08.687; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:08.688; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:08.688; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:08.688; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:08.688; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.240; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.241; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:54353/_s collection:collection1 shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.244; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:54353/_s/collection1/ and leader is http://127.0.0.1:40422/_s/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.244; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54353/_s
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.244; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.244; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.245; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.245; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.246; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.246; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.247; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.247; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.247; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.248; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.248; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.252; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.347; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.350; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:46014
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.351; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.351; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.352; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367127069252
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.352; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367127069252/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.353; org.apache.solr.core.CoreContainer; New CoreContainer 1038981649
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.353; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367127069252/'
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.354; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367127069252/'
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.416; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.417; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.417; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.418; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.418; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.419; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.419; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.420; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.420; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.421; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.426; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.426; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:39908/solr
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.427; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.428; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.431; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@5b9cd7d3 name:ZooKeeperConnection Watcher:127.0.0.1:39908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.431; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.433; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.436; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.438; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@7e7916c1 name:ZooKeeperConnection Watcher:127.0.0.1:39908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.438; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:09.441; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.193; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.193; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "node_name":"127.0.0.1:54353__s",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "core_node_name":"4",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54353/_s",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.197; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.197; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.197; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.197; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.197; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.197; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.253; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.253; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={onlyIfLeader=true&nodeName=127.0.0.1:54353__s&wt=javabin&version=2&checkLive=true&core=collection1&state=recovering&action=PREPRECOVERY&coreNodeName=4} status=0 QTime=1001 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.447; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46014__s
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.448; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:46014__s
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.450; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.450; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.451; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.450; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.451; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.451; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.452; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.452; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.453; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.453; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.453; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.454; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.459; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367127069252/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.459; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.460; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.460; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.461; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367127069252/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.461; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367127069252/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.462; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367127069252/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.483; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.510; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.511; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.515; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.807; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.812; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.815; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.826; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.829; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.832; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:10.833; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:10.833; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.833; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:10.834; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:10.834; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.835; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.835; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1367127069252/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty4/
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.835; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@71b2c5cd
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.836; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.836; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty4
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.836; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty4/index/
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:10.836; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.837; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty4/index
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.838; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b61c78f lockFactory=org.apache.lucene.store.NativeFSLockFactory@5817a0ea),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.838; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.840; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.840; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.840; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.841; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.841; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.841; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.842; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.842; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.842; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.844; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.847; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@3e2b304f main
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.847; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty4/tlog
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.847; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.848; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.852; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@3e2b304f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.854; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:10.854; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.702; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.703; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "node_name":"127.0.0.1:46014__s",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core_node_name":"5",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:46014/_s",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.703; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.704; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.707; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.707; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.707; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.707; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.707; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.707; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.856; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.856; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:46014/_s collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.859; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:46014/_s/collection1/ and leader is http://127.0.0.1:49707/_s/collection1/
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.860; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46014/_s
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.860; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.860; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.860; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.861; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.861; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.861; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.861; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.862; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.862; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.862; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.863; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.868; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.868; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.869; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.873; org.apache.solr.core.CoreContainer; Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367127056633/onenodecollectioncore
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.874; org.apache.solr.cloud.ZkController; Check for collection zkNode:onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.875; org.apache.solr.cloud.ZkController; Creating collection in ZooKeeper:onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.875; org.apache.solr.cloud.ZkController; Looking for collection configName
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.876; org.apache.solr.cloud.ZkController; Only one config set found in zk - using it:conf1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.877; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.878; org.apache.solr.cloud.ZkController; Load collection config from:/collections/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.880; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367127056633/onenodecollectioncore/'
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.920; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.963; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.964; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:11.968; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.254; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:40422/_s/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.254; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:54353/_s START replicas=[http://127.0.0.1:40422/_s/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:12.255; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.255; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.255; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.255; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.256; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.256; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:40422/_s/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.256; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.260; org.apache.solr.core.SolrCore; [collection1] webapp=/_s path=/get params={wt=javabin&version=2&getVersions=100&qt=/get&distrib=false} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.261; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.262; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d56b424 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65605fba),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.263; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.264; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d56b424 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65605fba),segFN=segments_1,generation=1}
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d56b424 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65605fba),segFN=segments_2,generation=2}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.264; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.264; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@15e86e5d realtime
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.265; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.265; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_s path=/update params={wt=javabin&version=2&openSearcher=false&commit_end_point=true&commit=true&waitSearcher=true&softCommit=false} {commit=} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.266; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.267; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.268; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.269; org.apache.solr.core.SolrCore; [collection1] webapp=/_s path=/replication params={wt=javabin&version=2&qt=/replication&command=indexversion} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.269; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.270; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.270; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.271; org.apache.solr.core.SolrCore; [collection1] webapp=/_s path=/replication params={wt=javabin&version=2&qt=/replication&generation=2&command=filelist} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.272; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.273; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty3/index.20130428003112272
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.273; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@2a5501f0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@622bc691) fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.275; org.apache.solr.core.SolrCore; [collection1] webapp=/_s path=/replication params={wt=filestream&qt=/replication&file=segments_2&generation=2&command=filecontent&checksum=true} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.276; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.277; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.278; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.278; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.279; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ed700be lockFactory=org.apache.lucene.store.NativeFSLockFactory@20b5109f),segFN=segments_1,generation=1}
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ed700be lockFactory=org.apache.lucene.store.NativeFSLockFactory@20b5109f),segFN=segments_2,generation=2}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.280; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.280; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.280; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1a028432 main
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.281; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1a028432 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.282; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty3/index.20130428003112272 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty3/index.20130428003112272;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.282; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty3/index.20130428003112272
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.282; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty3/index.20130428003112272
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.283; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.283; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.283; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.283; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.283; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.284; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.286; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.296; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.299; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.301; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:12.302; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:12.302; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.302; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:12.303; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:12.304; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.304; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.304; org.apache.solr.core.SolrCore; [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1367127056633/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367127053117/onenodecollection/
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.304; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@71b2c5cd
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.305; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.305; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367127053117/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.306; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367127053117/onenodecollection/index/
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:12.306; org.apache.solr.core.SolrCore; [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367127053117/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.306; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367127053117/onenodecollection/index
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.308; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@a42bf5f lockFactory=org.apache.lucene.store.NativeFSLockFactory@624cb9d0),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.308; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.310; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.310; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.310; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.311; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.311; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.311; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.312; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.312; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.313; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.315; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.317; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@65e87552 main
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.317; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367127053117/onenodecollection/tlog
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.318; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.318; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.321; org.apache.solr.core.SolrCore; [onenodecollectioncore] Registered new searcher Searcher@65e87552 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:12.322; org.apache.solr.cloud.ZkController; publishing core=onenodecollectioncore state=down
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.216; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.217; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "node_name":"127.0.0.1:46014__s",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "core_node_name":"5",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:46014/_s",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.220; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "node_name":"127.0.0.1:54353__s",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "core_node_name":"4",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54353/_s",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.224; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "node_name":"127.0.0.1:40422__s",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core":"onenodecollectioncore",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "collection":"onenodecollection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:40422/_s",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "roles":"none",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.224; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection onenodecollection with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.224; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.234; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.234; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.234; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.234; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.234; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.234; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.324; org.apache.solr.core.CoreContainer; registering core: onenodecollectioncore
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.324; org.apache.solr.cloud.ZkController; Register replica - core:onenodecollectioncore address:http://127.0.0.1:40422/_s collection:onenodecollection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.325; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.335; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.337; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.337; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.337; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:40422/_s/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.337; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.338; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:40422/_s/onenodecollectioncore/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.338; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:40422/_s/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.338; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.869; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:13.869; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={onlyIfLeader=true&nodeName=127.0.0.1:46014__s&wt=javabin&version=2&checkLive=true&core=collection1&state=recovering&action=PREPRECOVERY&coreNodeName=5} status=0 QTime=2001 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:14.741; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:14.749; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:14.749; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:14.749; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:14.749; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:14.749; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:14.749; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:14.796; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:40422/_s/onenodecollectioncore/ and leader is http://127.0.0.1:40422/_s/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:14.797; org.apache.solr.cloud.ZkController; No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:40422/_s
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:14.797; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:14.797; org.apache.solr.cloud.ZkController; publishing core=onenodecollectioncore state=active
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:14.799; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:14.800; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={wt=javabin&version=2&numShards=1&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367127053117/onenodecollection&name=onenodecollectioncore&action=CREATE&collection=onenodecollection&roles=none} status=0 QTime=2927 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:14.801; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:14.801; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.803; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.870; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:49707/_s/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.871; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:46014/_s START replicas=[http://127.0.0.1:49707/_s/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:15.871; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.871; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.871; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.872; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.872; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.872; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:49707/_s/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.872; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.875; org.apache.solr.core.SolrCore; [collection1] webapp=/_s path=/get params={wt=javabin&version=2&getVersions=100&qt=/get&distrib=false} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.876; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.878; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@694e39da lockFactory=org.apache.lucene.store.NativeFSLockFactory@5739901e),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.878; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.878; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@694e39da lockFactory=org.apache.lucene.store.NativeFSLockFactory@5739901e),segFN=segments_1,generation=1}
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@694e39da lockFactory=org.apache.lucene.store.NativeFSLockFactory@5739901e),segFN=segments_2,generation=2}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.879; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.879; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@73edb8c9 realtime
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.879; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.880; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_s path=/update params={wt=javabin&version=2&openSearcher=false&commit_end_point=true&commit=true&waitSearcher=true&softCommit=false} {commit=} 0 4
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.880; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.881; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.882; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.882; org.apache.solr.core.SolrCore; [collection1] webapp=/_s path=/replication params={wt=javabin&version=2&qt=/replication&command=indexversion} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.883; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.883; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.883; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.885; org.apache.solr.core.SolrCore; [collection1] webapp=/_s path=/replication params={wt=javabin&version=2&qt=/replication&generation=2&command=filelist} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.886; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.886; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty4/index.20130428003115886
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.886; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c87adfb lockFactory=org.apache.lucene.store.NativeFSLockFactory@74fabc20) fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.888; org.apache.solr.core.SolrCore; [collection1] webapp=/_s path=/replication params={wt=filestream&qt=/replication&file=segments_2&generation=2&command=filecontent&checksum=true} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.889; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.890; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.891; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.891; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b61c78f lockFactory=org.apache.lucene.store.NativeFSLockFactory@5817a0ea),segFN=segments_1,generation=1}
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b61c78f lockFactory=org.apache.lucene.store.NativeFSLockFactory@5817a0ea),segFN=segments_2,generation=2}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.892; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.892; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.892; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@252561b5 main
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.893; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@252561b5 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.894; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty4/index.20130428003115886 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty4/index.20130428003115886;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.894; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty4/index.20130428003115886
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.894; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty4/index.20130428003115886
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.894; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.895; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.895; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.895; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:15.896; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:16.257; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:16.258; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "node_name":"127.0.0.1:40422__s",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core":"onenodecollectioncore",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:40422__s_onenodecollectioncore",
[junit4:junit4]   1>   "collection":"onenodecollection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:40422/_s",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "roles":"none",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:16.260; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "node_name":"127.0.0.1:46014__s",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "core_node_name":"5",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:46014/_s",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:16.263; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:16.263; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:16.264; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:16.263; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:16.263; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:16.263; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:16.805; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:16.806; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished - collection: onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:16.806; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:16.816; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:16.817; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@212cdda4 name:ZooKeeperConnection Watcher:127.0.0.1:39908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:16.817; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> / (2)
[junit4:junit4]   1> DATA:
[junit4:junit4]   1>     
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1>  /solr (7)
[junit4:junit4]   1>   /solr/overseer (3)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       
[junit4:junit4]   1>    /solr/overseer/queue-work (0)
[junit4:junit4]   1>    /solr/overseer/queue (0)
[junit4:junit4]   1>    /solr/overseer/collection-queue-work (0)
[junit4:junit4]   1>   /solr/collections (3)
[junit4:junit4]   1>    /solr/collections/onenodecollection (2)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {
[junit4:junit4]   1>          "router":"compositeId",
[junit4:junit4]   1>          "configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/onenodecollection/leaders (1)
[junit4:junit4]   1>      /solr/collections/onenodecollection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "node_name":"127.0.0.1:40422__s",
[junit4:junit4]   1>            "core":"onenodecollectioncore",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:40422/_s"}
[junit4:junit4]   1>     /solr/collections/onenodecollection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/onenodecollection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/onenodecollection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/onenodecollection/leader_elect/shard1/election/89596038553206790-127.0.0.1:40422__s_onenodecollectioncore-n_0000000000 (0)
[junit4:junit4]   1>    /solr/collections/control_collection (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "node_name":"127.0.0.1:51036__s",
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:51036/_s"}
[junit4:junit4]   1>     /solr/collections/control_collection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/shard1/election/89596038553206787-1-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/control_collection/shards (0)
[junit4:junit4]   1>    /solr/collections/collection1 (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/collection1/leaders (2)
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "node_name":"127.0.0.1:49707__s",
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:49707/_s"}
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard2 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "node_name":"127.0.0.1:40422__s",
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:40422/_s"}
[junit4:junit4]   1>     /solr/collections/collection1/leader_elect (2)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard1/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89596038553206792-3-n_0000000000 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89596038553206796-5-n_0000000001 (0)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard2 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard2/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89596038553206794-4-n_0000000001 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89596038553206790-2-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/collection1/shards (0)
[junit4:junit4]   1>   /solr/live_nodes (5)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:51036__s (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:54353__s (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:46014__s (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:49707__s (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:40422__s (0)
[junit4:junit4]   1>   /solr/overseer_elect (2)
[junit4:junit4]   1>    /solr/overseer_elect/leader (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"id":"89596038553206787-127.0.0.1:51036__s-n_0000000000"}
[junit4:junit4]   1>    /solr/overseer_elect/election (5)
[junit4:junit4]   1>     /solr/overseer_elect/election/89596038553206794-127.0.0.1:54353__s-n_0000000003 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89596038553206796-127.0.0.1:46014__s-n_0000000004 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89596038553206792-127.0.0.1:49707__s-n_0000000002 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89596038553206787-127.0.0.1:51036__s-n_0000000000 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89596038553206790-127.0.0.1:40422__s-n_0000000001 (0)
[junit4:junit4]   1>   /solr/clusterstate.json (0)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       {
[junit4:junit4]   1>         "onenodecollection":{
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"127.0.0.1:40422__s_onenodecollectioncore":{
[junit4:junit4]   1>                   "node_name":"127.0.0.1:40422__s",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "core":"onenodecollectioncore",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "collection":"onenodecollection",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:40422/_s",
[junit4:junit4]   1>                   "roles":"none",
[junit4:junit4]   1>                   "leader":"true"}}}},
[junit4:junit4]   1>           "router":"compositeId"},
[junit4:junit4]   1>         "collection1":{
[junit4:junit4]   1>           "shards":{
[junit4:junit4]   1>             "shard1":{
[junit4:junit4]   1>               "range":"80000000-ffffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "3":{
[junit4:junit4]   1>                   "node_name":"127.0.0.1:49707__s",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:49707/_s",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "5":{
[junit4:junit4]   1>                   "node_name":"127.0.0.1:46014__s",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:46014/_s"}}},
[junit4:junit4]   1>             "shard2":{
[junit4:junit4]   1>               "range":"0-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "2":{
[junit4:junit4]   1>                   "node_name":"127.0.0.1:40422__s",
[junit4:junit4]   1>                   "shard":"shard2",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:40422/_s",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "4":{
[junit4:junit4]   1>                   "node_name":"127.0.0.1:54353__s",
[junit4:junit4]   1>                   "shard":"shard2",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:54353/_s"}}}},
[junit4:junit4]   1>           "router":"compositeId"},
[junit4:junit4]   1>         "control_collection":{
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"1":{
[junit4:junit4]   1>                   "node_name":"127.0.0.1:51036__s",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "collection":"control_collection",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:51036/_s",
[junit4:junit4]   1>                   "leader":"true"}}}},
[junit4:junit4]   1>           "router":"compositeId"}}
[junit4:junit4]   1>   /solr/aliases.json (0)
[junit4:junit4]   1>   /solr/configs (1)
[junit4:junit4]   1>    /solr/configs/conf1 (9)
[junit4:junit4]   1>     /solr/configs/conf1/schema.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/protwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/stopwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/open-exchange-rates.json (0)
[junit4:junit4]   1>     DATA:
[junit4:junit4]   1>         {
[junit4:junit4]   1>           "disclaimer": "This data is not real, it was synthetically created to match currency.xml.  It is modeled after the data format available from openexchangerates.org.  See https://openexchangerates.org/documentation for details",
[junit4:junit4]   1>           "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4:junit4]   1>           "timestamp": 1332070464,
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "IMPORTANT NOTE": "In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "base": "USD",
[junit4:junit4]   1>           "rates": {
[junit4:junit4]   1>             "USD": 1,
[junit4:junit4]   1>             "JPY": 81.29,
[junit4:junit4]   1>             "EUR": 2.5,
[junit4:junit4]   1>             "GBP": 0.5,
[junit4:junit4]   1>             "MXN": 2.0
[junit4:junit4]   1>           }
[junit4:junit4]   1>         }
[junit4:junit4]   1>         
[junit4:junit4]   1>     /solr/configs/conf1/solrconfig.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/old_synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/currency.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1> 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:16.853; org.apache.solr.cloud.ChaosMonkey; monkey: stop shard! 51036
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:16.854; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=961078143
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:17.769; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:17.770; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=null message={
[junit4:junit4]   1>   "node_name":"127.0.0.1:51036__s",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core_node_name":"1",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:51036/_s",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:17.774; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:17.774; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:17.774; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:17.774; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:17.775; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.855; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.856; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.858; org.apache.solr.core.SolrCore; [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@5ea52e41
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.861; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.861; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.862; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.862; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.862; org.apache.solr.core.SolrCore; [collection1] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.863; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.863; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/control/data [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/control/data;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.863; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/control/data
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.863; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/control/data/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/control/data/index;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.864; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/control/data/index
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.865; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89596038553206787-127.0.0.1:51036__s-n_0000000000) am no longer a leader.
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.865; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.866; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.866; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.866; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.866; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.867; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.867; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.867; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.869; org.apache.solr.cloud.Overseer; Overseer (id=89596038553206790-127.0.0.1:40422__s-n_0000000001) starting
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.871; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.872; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.872; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.872; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.873; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.874; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "node_name":"127.0.0.1:51036__s",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core_node_name":"1",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:51036/_s",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.878; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.878; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.878; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.878; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.888; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/_s,null}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.940; org.apache.solr.cloud.ChaosMonkey; monkey: stop shard! 40422
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:18.940; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=233769106
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:20.166; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:20.166; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:20.382; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:20.383; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=null message={
[junit4:junit4]   1>   "node_name":"127.0.0.1:40422__s",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core":"onenodecollectioncore",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:40422__s_onenodecollectioncore",
[junit4:junit4]   1>   "collection":"onenodecollection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:40422/_s",
[junit4:junit4]   1>   "roles":"none",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:20.385; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=null message={
[junit4:junit4]   1>   "node_name":"127.0.0.1:40422__s",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core_node_name":"2",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:40422/_s",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:20.388; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:20.388; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:20.388; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:20.388; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:21.942; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:21.943; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:21.946; org.apache.solr.cloud.ZkController; publishing core=onenodecollectioncore state=down
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:21.947; org.apache.solr.core.SolrCore; [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@365e42a0
[junit4:junit4]   1> INFO  - 2013-04-2

[...truncated too long message...]

key: stop shard! 46014
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:24.200; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=1038981649
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:24.349; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:24.349; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:25.202; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:25.202; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:25.205; org.apache.solr.core.SolrCore; [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@2a1380ac
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:25.209; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:25.210; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:25.210; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:25.211; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:25.212; org.apache.solr.core.SolrCore; [collection1] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:25.212; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:25.212; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty4;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:25.213; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty4
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:25.213; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty4/index;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:25.213; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1367127053116/jetty4/index
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:25.215; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89596038553206796-127.0.0.1:46014__s-n_0000000004) am no longer a leader.
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:25.216; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:25.216; org.apache.zookeeper.server.NIOServerCnxn; caught end of stream exception
[junit4:junit4]   1> EndOfStreamException: Unable to read additional data from client sessionid 0x13e4f1f533f000c, likely client has closed socket
[junit4:junit4]   1> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   1> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   1> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:25.216; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> WARN  - 2013-04-28 05:31:25.217; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:25.237; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/_s,null}
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:25.297; org.apache.solr.SolrTestCaseJ4; ###Ending testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:25.301; org.apache.solr.cloud.ZkTestServer; connecting to 127.0.0.1:39908 39908
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1367127053117
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=E0ED5AD42E60CEC5 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ko -Dtests.timezone=America/Winnipeg -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR   32.2s J1 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:49707/_s/onenodecollectioncore returned non ok status:404, message:Can not find: /_s/onenodecollectioncore/update
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([E0ED5AD42E60CEC5:610BD4CC593FAEF9]:0)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:387)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   1> INFO  - 2013-04-28 05:31:25.349; org.apache.solr.SolrTestCaseJ4; ###deleteCore
[junit4:junit4]   2> 32241 T1642 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=ko, timezone=America/Winnipeg
[junit4:junit4]   2> NOTE: Linux 3.2.0-40-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=2,free=44674824,total=289472512
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestPartialUpdateDeduplication, SpellCheckComponentTest, FullSolrCloudDistribCmdsTest, TestQuerySenderNoQuery, TestDefaultSimilarityFactory, TestZkChroot, DocumentAnalysisRequestHandlerTest, TestSolrQueryParserDefaultOperatorResource, NoCacheHeaderTest, TestDistributedSearch, TestStressReorder, TestUtils, TestSolrXml, DOMUtilTest, TestPropInject, URLClassifyProcessorTest, TestFastOutputStream, TestStressLucene, MultiTermTest, UniqFieldsUpdateProcessorFactoryTest, SolrCmdDistributorTest, TestDynamicFieldCollectionResource, XmlUpdateRequestHandlerTest, ShardRoutingCustomTest, ChaosMonkeyShardSplitTest, CopyFieldTest, DefaultValueUpdateProcessorTest, SuggesterTSTTest, TestDistributedGrouping, TestDefaultSearchFieldResource, BasicZkTest, TestManagedSchema, TestFiltering, EchoParamsTest, FieldAnalysisRequestHandlerTest, TestSchemaVersionResource, CoreContainerCoreInitFailuresTest, TestAtomicUpdateErrorCases, HighlighterConfigTest, TestMultiCoreConfBootstrap, TestRTGBase, ZkSolrClientTest, IndexBasedSpellCheckerTest, TestCoreDiscovery, LeaderElectionIntegrationTest, ZkNodePropsTest, TermVectorComponentDistributedTest, PingRequestHandlerTest, TestNumberUtils, TestSchemaSimilarityResource, TestJmxMonitoredMap, TestQueryTypes, SolrPluginUtilsTest, TestFieldCollectionResource, RequestHandlersTest, TestComponentsName, TestBinaryField, TestSolrJ, XsltUpdateRequestHandlerTest, TestWordDelimiterFilterFactory, TestPostingsSolrHighlighter, ConvertedLegacyTest, DirectSolrSpellCheckerTest, SortByFunctionTest, TestBM25SimilarityFactory, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 33.02s, 1 test, 1 error <<< FAILURES!

[...truncated 484 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:378: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:358: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:437: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1240: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:884: There were test failures: 293 suites, 1219 tests, 1 error, 13 ignored (7 assumptions)

Total time: 35 minutes 38 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0-ea-b86 -XX:+UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure